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ABSTRACT 


A workshop  on  issues  associated  with  registration  and  rectification  of  NASA  sensor 
data  for  earth  applications  was  held  on  November  17-19 * 1981*  Attendees  from  NASA 
centers,  other  federal  agencies  and  departments,  industry,  and  educational  insti- 
tutions discussed  the  issues  in  a broad  context  ranging  from  NASA  earth  observa- 
tions systems  to  user  applications* 

Tne  points  and  recommendations  presented  at  the  workshop  can  be  divided  into 
three  categories:  a)  concerns  about  the  present  situation  and  suggestions  for 

improvement,  b)  well  defined  near-  and  long-range  applications  research  tasks 
having  low  manpower  and  funding  requirements,  c)  some  medium-range  technology 
augmentation  research  areas,  elements  of  which  were  brought  up  by  several  panels, 
which  would  require  significant  manpower  and  budget  resources  Most  of  the 
concerns  raised  can  be  forwarded  to  the  NASA  branches  and  program  offices  for  the 
appropriate  disciplines,  or  incorporated  as  justification  for  Information  Systems 
Office  funded  SRT.  Similarly,  the  suggestions  for  small  applications  research 
tasks  can  be  incorporated  within  the  Information  Systems  SRT  program  or  other 
programs . 

The  medium-range  (3-5  yean)  technology  augmentation  research  areas  provide  an 
opportunity  for  the  Information  Systems  Office  to  propose  significant  new  starts 
in  FY83.  Three  proposed  areas  axe:  1)  Advanced  Image  Registration  System, 

2)  Master  Ground  Control  Point/Pattern  Library  System,  3)  Error  Budget  Modelling 
and  Sensor  Verification  Testing  System, 

A longer-range  goal  should  be  the  development  of  sensor  platform  stability  and 
associated  attitude  control  to  provide  5-10  meter  multi-temporal  registration 
accuracy  with  minimal  or  no  ground  control. 
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1.0  EXECUTIVE  SUMMARY 


1 . 1 HIGHLIGHTS 

A workshop  on  issues  associated  with  registration  and  rectification  of  NASA 
sensor  data  for  earth  applications  was  held  on  November  17-19,  1981.  Atten- 
dees from  NASA  centers,  other  federal  agencies  and  departments,  industry,  and 
educational  institutions  discussed  the  issues  in  a broad  context  ranging  from 
NASA  earth  observations  systems  to  user  applications.  The  results  of  the 
presentations  and  deliberations  showed  that  some  promising  technologies  and 
procedures  can  and  should  be  implemented  within  the  next  few  years  to  advance 
the  current  technology  and  improve  future  ground  segment  processing.  A goal 
for  1990  should  be  the  development  of  sensor  platform  stability  and  associated 
attitude  control  to  provide  5-10  meter  multitemporal  registration  accuracy 
with  minimal  or  no  ground  control. 

A long  range  goal  of  the  Information  Systems  Office  is  to  provide  the  set  of 
techniques  needed  to  digitally  register  and  rectify  remotely  sensed  data,  in- 
tegrate remotely  sensed  data  with  conventional  data,  reduce  image  geometric 
and  mapping  errors  while  maintaining  image  quality,  and  reduce  system  and  pro- 
duct costs  through  improving  processing  efficiency  and  adopting  more  automated 
techniques.  The  workshop  sought  to  provide  a solid  basis  for  NASA  planning  in 
this  area  by  identifying  current  needs,  determining  current  technology,  and 
recommending  programmatic  elements.  The  agenda  was  structured  to  achieve  the 
stated  objectives  by  having  presentations  on  user  needs,  space  segment  errors 
and  ground  segment  errors  during  the  first  day.  For  half  of  the  second  day, 
presentations  were  given  on  salient  aspects  of  the  registration  and  rectifica- 
tion process  as  well  as  error  analysis  procedures.  The  remainder  of  the  work- 
shop was  devoted  to  working  group  discussions.  Each  of  the  seven  working 
groups  was  charged  to  assess  the  state  of  the  art,  and  identify  research  tasks 
suitable  for  their  subject  area.  The  results  of  the  working  group  recommenda- 
tions and  general  discussions  are  summarized  below. 

The  essential  elements  with  registration  were  apportioned  to  three  working 
groups:  image  sharpness,  feature  extraction,  and  inter-image  matching.  All 
three  working  groups  noted  the  large  amount  of  non-NASA  work  that  has  been 
performed  and  recommended  that  state-of-the-art  surveys  be  quickly  undertaken 
to  prepare  for  key  technology  augmentation  research  projects  of  significant 
scope  and  provide  justification  for  initiating  low-budget  SRT  tasks.  The  im- 
age sharpness  group  proposed  near-term  SRT  tasks  on  the  relationship  between 
sensor  IFOV  and  effective  IFOV  on  sharoening  images  for  matching  and  ground 
control  point  identification.  They  also  noted  the  need  for  improved  SAR  image 
formation  SRT.  Longer-range  studies  proposed  were  concerned  with  the  poten- 
tial of  techniques  to  avoid  aliasing  errors  and  diffraction-related  blurring 
on  MLA  sensor  systems.  The  feature  extraction  group  noted  that  recent  re- 
search results  have  revealed  the  potential  to  use  subpixel  estimation  of  local 
features  to  impr^  •»  ground  control  point  selection  and  inter-image  matching. 
Focused  funding  s.  ,uld  provide  significant  near-term  results  here.  A longer- 
range  project  of  much  greater  scope  would  be  the  development  of  ground  control 
pattern  (as  opposed  to  control  point)  libraries  to  provide  improved  accuracy, 
greater  generality,  and  world-wide  capability  for  the  registration  process. 
As  similar  suggestions  were  brought  up  by  other  working  groups,  they  were 
treated  in  greater  detail  later.  The  inter-image  matching  group  recommended 


that  several  low-level  SRT  tasks  be  slated  for  early  funding  to  assess  the  ac- 
curacy of  matching  by  different  techniques  under  different  conditions  to  guide 
individual  users  and  project-oriented  image  registration/rectification  sys- 
tems. This  group  also  suggested  that  multitemporal  and  multisensor  registra- 
tion systems  with  their  associated  libraries  be  s major  endeavor  over  the  next 
3-5  years. 

The  essential  elements  associated  with  rectification  were  apportioned  to  one 
group  concerned  with  remapping  and  another  associated  with  resampling  proce- 
dures. Both  groups  pointed  out  the  need  for  state-of-the-art  technology  as- 
sessments prior  to  initiation  of  major  programs,  and  the  high  potential  return 
from  well  formulated  testing  of  algorithms  on  selected  data  sets  of  actual  and 
synthetic  imagery.  In  addition,  the  remapping  group  pointed  out  the  need  for 
SRT  tasks  that  incorporate  standard  phetogrammetric  methodology  and  formulas 
and  more  fully  utilize  platform  and  calibration  data  from  current  anu  proposed 
sensors  to  reproject  digital  imagery.  The  impact  of  improved  platform  stabil- 
ity and  integration  of  GPS  measurements  on  reduced  ground  segment  processing 
needs  to  be  critically  assessed.  The  group  also  highlighted  the  need  for  a 
substantial  effort  in  the  development  of  remapping  software  and  systems  that 
are  modular  and  transportable.  This  need  stems  from  the  fact  that  previous 
and  current  ground  segment  image  data  rectification  tasks  are  faced  with  ex- 
ternal forces  difficult  to  resolve,  namely  users  wanting  a wide  variety  of  map 
projections  and  data  processing  capabilities  which  private  industry  has  not 
yet  cost-effectively  developed  nor  has  an  individual  government  facility  ef- 
ficiently supplied.  The  resampling  group  also  raised  the  need  for  transport- 
able software  and  systems  that  could  be  integrated  with  remapping  systems. 
They  pointed  out  the  need  for  an  SRT  effort  in  algorithms  to  compensate  and 
provide  valid  estimates  for  missing  data  occurrences  in  upcoming  TM  and  MLA 
sensor  systems.  As  a general  point,  it  was  noted  that  future  sensor  design 
should  take  into  account  the  fact  that  resampling/reprojection  will  be  under- 
taken and  as  a result  sensor  system  designs  should  optimize  for  resampling 
rather  than  IFOV  concerns. 

The  error  analysis  procedures  were  subdivided  into  an  error  characterization 
and  an  error  budget  group  and  methods  of  verification  group.  Both  groups 
pointed  out  that  this  area  has  little  prior  history  within  NASA  but  is  experi- 
encing considerable  attention  now  that  sensor  systems  data  are  being  inte- 
grated with  other  information  whose  only  common  attribute  is  a latitude  and 
longitude  position  identified  to  a given  level  of  accuracy.  The  error  charac- 
terization and  error  budget  group  recommended  several  SRT  tasks,  both  short 
and  long  term  but  at  a modest  level  of  effort,  to  evaluate  existing  error  mod- 
els (i.e.,  for  Landsat  D/TM)  and  develop  error  models  for  future  systems  def- 
inition and  trade-off  studies.  A major  effort  was  proposed  to  help  break  down 
the  impasse  that  frequently  occurs  between  user  requirements  and  system  devel- 
opment decisions.  It  was  proposed  that  a system  that  iterates  user  require- 
ments and  space  imaging  system  error  budget  characteristics  be  developed  to 
achieve  a satisfactory  balance  of  alternatives  that  are  most  cost-effective. 
The  verification  methods  group  proposed  a similar,  large-scale  program  which 
could  mesh  the  error  budget  predictive  modeling  with  end-to-end  image  verifi- 
cation testing  systems. 

In  summary,  the  points  and  recommendations  presented  at  the  workshop  can  be 
divided  into  three  categories:  a)  concerns  about  the  present  situation  and 
suggestions  for  improvement,  b)  well  defined  near-  and  long-range  applications 
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research  tasks  having  low  manpower  and  funding  requirements,  c)  some  medium- 
range  technology  augmentation  research  areas,  elements  of  which  were  brought 
up  by  several  panels,  which  would  require  significant  manpower  and  budget  re- 
sources. Most  of  the  concerns  raised  can  be  forwarded  to  the  appropriate  NASA 
discipline  branches  and  project  program  offices  or  incorporated  as  justifica- 
tion for  Information  Systems  Office  funded  SRT.  Similarly,  the  suggestions 
for  small  applications  research  tasks  can  be  incorporated  within  the  Informa- 
tion Systems  SRT  program  or  other  programs. 

The  medium-range  (3-5  year)  technology  augmentation  research  areas,  however, 
provide  an  opportunity  for  the  Information  Systems  Office  to  propose  signifi- 
cant new  starts  in  FY83.  Each  of  the  technology  augmentations  should  improve 
upon  the  registration  and  rectification  elements  of  ground  segment  data  han- 
dling to  a degree  which  would  permit  major  as  opposed  to  incremental  improve- 
ment of  the  situation  as  it  exists  today.  The  three  proposed  programs  are: 

1.  Advanced  Image  Registration  System:  Expanded  user  reeds  in  registra- 

tion of  multiple  sensor  data  and  more  precise  local  registration  can 
best  be  met  for  the  next  decade  by  improving  the  analyst  capability 
to  discern  matching  ground  control  patterns/points.  The  system  would 
include  smart  imaging  terminals  augmented  with  image  enhancement  al- 
gorithms and  procedures  designed  to  improve  an  individual  analyst’s 
throughput  and  success/accuracy  probaoility  for  registering  multitem- 
poral and  multisensor  ground  control  pattern/points.  The  system 
would  also  include  automated  registration  procedures  and  selected 
projections  for  remapping  imagery  as  transportable  software  modules. 

2.  Master  Ground  Control  Point/Pattern  Library  System:  Expanded  re- 

quirements for  automated  ground  control  point/pattern  integration 
with  imaging  sensor  data  will  best  be  met  by  the  orderly  development 
of  a library  that  accepts  and  verifies  data  from  a variety  of  sources 
end  xs  upwardly  expandable  to  future  sensor  systems.  The  library 
would  include  the  variety  of  algorithms  required  for  testing  and  up- 
dating ground  control  point  location  in  images  of  different  sensors 
under  different  conditions.  It  would  ilso  include  the  data  archive 
and  data  base  management  required  to  provide  world-wide  coverage  for 
NASA  satellite  sensor  systems. 

3.  Error  Budget  Modelling  and  Sensor  Verification  Testing  System:  NASA 

project  management  needs  an  iterative  capability  to  evaluate  user  re- 
quirements and  potential  engineering  design  trade-offs  prior  to 
launch.  It  also  needs  a general  purpose  end-to-end  verification  of 
performance  postlaunch.  The  testing  system  would  provide  a dynamic 
environment  to  test  and  verify  alternative  registration  and  rectiii- 
cation  strategies  (e.g.,  use  of  GPS  for  Landsat  D)  for  ongoing  and 
future  sensors  which  can  be  readily  understood  by  potential  users, 
and  minimize  ambiguity  associated  with  specifications  and 

performance. 
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1.2  RECOMMENDED  RESEARCH  TASXS  BY  PANEL 


1.2.1  Image  Sharpness  Panel 
Near-Term  Tasks 


1.  Study  relationships  between  effective  IFOV  and  "optimal"  image  struc- 
tures for  sharpening  images  (4  manyears,  $20k  computer,  2 year 
duration) . 

2.  Study  relationships  of  IOFV  on  performance  of  matching  algorithms  (1 
manyear,  $10k  computer,  1 year  duration). 

Undertake  a state-of-the-art  survey  of  published  and  unclassified  re- 
search in  image  sharpening  funded  by  DOD  in  recent  years.  (1  manyear, 
1 year  duration) . 

Long-Range  Tasks 

3.  Study  the  potential  of  using  optical  prefiltering  on  MLA  systems  to 
reduce  the  potential  for  aliasing  errors.  (3  manyears,  $20k  computer, 
3 years  duration). 

4.  Determine  appropriate  compensation/sharpening  techniques  needed  to  re- 
duce defractor  limited  image  blurring  associated  with  thermal  IR  MLA 
sensors  and  passive  microwave  sensors  (5  manyears,  $40k  computer,  5 
years  duration). 

Investigate  optical  and  digital  correlator  techniques  to  sharpen  SAR 
images.  (3  manyears,  $40k  computer,  3 years  duration). 

1.2.2  Feature  Extraction  Panel 

Near-Term  Tasks 


1.  Inventory  of  current  capabilities  and  concepts  of  image/f mature  models 
for  estimating  the  positions  of  image  features  to  less  hen  a pixel. 
(1  manyears,  1 year  duration). 

2.  Accuracy  assessment  of  models  used  to  estimate  the  positions  of  image 
features  to  less  than  a pixel.  (3  manyears,  $2 OK  computer,  2 manyears 
duration) . 

Long-Range  Tasks 

3.  Development  of  subpixel  feature  estimation  models  for  ground  control 
point  identification  and  selection.  (6  manyears,  $40k  computer,  4 
years  duration) . 

4.  Ground  control  pattern  library  design  development  and  testing  includ- 
ing single  or  multiple  sensor  feasibility  and  DBMS  capabilities.  (10 
manyears,  $50k  computer,  5 years  duration). 
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1.2.3  Inter-Image  Matching  Pan®l 

Near-Term  Tasks 

1.  Investigate  the  potential  utility  of  commercially  available  special 
purpose  hardware  to  determine  whether  i '.s  economical  to  speed  up 
commonly  used  algorithms  for  inter-imrge  matching.  (1  manyear,  1 year 
duration) . 

2.  Study  to  determine  interaction  of  inte  ‘-image  matching  procedures  and 
selection  of  GCPs  for  a given  sensor,  thereby  providing  guidance  on 
selection  criteria  for  future  libraries  (3  manyears,  $5Ck  computer,  2 
years  duration)  (multiple  task). 

3.  Determine  the  feasibility  of  developing  a centralized  system  to  per- 
form registration  and  rectification  for  various  sensors  (i.e.,  SAR, 
MLA,  MSS,  etc.)  (2  manyears,  2 years  duration). 

Long-Range  Tasks 

1.  Investigate  the  effect  of  number  and  distribution  of  control  points 

required  for  rectification  of  a given  image  (sensor)  and  its  charac- 
teristics using:  a priori  model,  selection  of  degree  model,  or  devel- 

opment of  a model  with  an  adaptive  warping  function  capability;  and 
determining  the  adequacy  of  fit.  (5  manyears,  $40k  computer,  4 years 
duration) . 

2.  Study  to  determine  the  feasibility  of  a highly  automated,  global,  mul- 
tisensor control  point  library.  (Similar  to  Feature  Extraction  and 
Remapping  Panel  Recommendations). 

1.2.4  Remapping  Panel 

Near -Term  Tasks 

1.  • Development  of  a transportable  software  and  general  hardware  design 

specification  for  image  warping  and  rotation  for  remapping.  (4  man- 
years, $20k  computer,  2 years  duration). 

2.  Generate  simulated  and  standard  data  sets  for  aircraft  and  spacecraft 
images  and  design  simulation  study  algorithms  for  remapping.  (4  man- 
years, $20k  computer,  2 years  duration). 

3.  Develop  suitable  techniques  for  image  mosaicking  and  multitemporal 
overlays  (3  manyears,  $20k  computer,  2 years  duration). 

4.  Develop  and  implement  photogrammetric  rectification  and  block  adjust- 
ment techniques  for  overlapping  digital  imagery  (3  manyears,  $20k  com- 
puter, 2 years  duration). 

5.  Establish  optimized  aircraft  mission  design  alternatives  (1  manyear,  1 
year  duration). 
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Long-Range  Tasks 


1.  Investigate,  model,  and  implement  rectification  to  sensors  (scanner, 
MLA,  SAR).  (10  manyears,  $50k  computing,  5 years  duration). 

2.  Develop  correspondence  (similarity)  measures  for  finding  control 
points  between  images  from  different  sensors.  (4  manyears,  $20k  com- 
puting, 4 years  duration). 

3.  Investigate  and  develop  models  for  compensation/correction  of  atti- 
tude. Design  advanced  attitude  sensors  and  develop  capability  for 
on-board  compensation  (aircraft  and  spacecraft).  (7  manyears,  $20k 
computing,  5 years  duration). 

4.  Develop  Ground  Control  Point  Files  (similar  to  feature  extraction  and 
inter-image  Mapping  Panel  recommendations). 

1.2.5  Resampling  Panel 

Near-Term  Tasks 

1.  Define  the  point  spread  function  (PSF)  that  will  yield  the  "best*'  re- 
sult following  resampling.  Parameters  would  include  noise,  shape  of 
the  desired  output  PSF,  and  instrumental  constraints.  (3  manyears, 
$10k  computing,  3 years  duration). 

2.  Develop  standard  data  sets  of  both  real  and  synthetic  data,  test  and 
compare  resampling  algorithms  under  varying  conditions,  and  publish 
results.  (5  manyears,  $40k  computing,  2 years  duration). 

3.  Develop  methods  of  filling  data  gap  regions  on  scanner  and  MLA  type 
sys^'ms  associated  with  dead  detectors  or  scan  gap*.  (6  manyears, 
$20k  computing,  3 years  duration). 

4.  Document  and  test  and  last  squares  resampling  approach.  Cost  benefit 
analyses  must  also  be  done  and  clear  definitions  of  applicability  and 

mitations  ascertained.  (1  manyear,  $5k  computing,  1 year  duration). 

5.  Investigate  the  benefits  of  going  beyond  the  linear  restriction  on  re- 
sampling algorithms.  (2  manyear,  $5k  computing,  1 year  duration). 

Long-Range  Tasks 

1.  Discover  a "benign"  resampling  method  for  archiving  data  (5  manyears, 
$20k  computing,  5 years  duration,  2+  groups). 

2.  Investigate,  from  the  end  use  perspective,  optimal  resampling  func- 
tions. Determine  optimal  ~esamples  based  upon:  radiometric  accuracy, 

geometric  fidelity,  or  spatial  feature  er*-raction  (5  manyears  $20k 
computing,  5 years  duratic:.,  2+  group). 
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1.2.6  Error  Characterization  and  Error  Budget  Panel 
Near-Term  Tasks 


1.  Obtain  and  evaluate  the  existing  Thematic  Mapper  error  models  (5  man- 
years,  $50k  comouting,  3 years  duration). 

2.  Develop  error  models  for  future  system  definition  and  tradeoff  studies 
on  advanced  sensors,  spscecraft/shuttle,  processing,  and  information. 
(5  manyears,  $50k  computing,  3 years  duration). 

Long-Range  Tasks 

1.  Develop  the  system  and  procedures  required  to  provide  iterative  user 
involvement  in  system  error  budgeting  and  error  model  development, 
with  verification  on  real  and  synthetic  data  sets.  (20  manyears, 
$100k  computing,  5 years  duration). 

2.  Create  a Positioning  Error  Budget  Study  Group  (2  manyears,  $100k  trav- 
el, 5 years  duration). 

1.2.7  Verification  Methods  Panel 

Near-Term  Tasks 


1. 


Identify  verification  performance  measures  and  review  current  verifi- 
cation approaches.  (3  manyears,  $20k  computer,  1 year  duration). 


2. 


Undertake  an  image  verification  end-to-end  test  using  a selected  sys- 
tem as  a test  bed.  (3  manyears,  $20k  computer,  1 year  duration). 


Long-Range  Tasks 

1.  Compile  synthetic  and  real  data  sets  displaying  the  range  of  distor- 
tion characteristics  for  advanced  sensors  (MLA,  SAR,  stereo)  and  iden- 
tify recommended  verification  techniques  (10  manyears,  $100k  comput- 
ing, 5 years  duration). 

2.  Undertake  image  verification  end-to-end  tests  on  advanced  sensors 
(i.e.,  MLA,  SAR,  stereo).  (10  manyears,  $100k  computing,  5 years  dura- 
tion) . 
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1.3  PROPOSED  TECHNOLOGY  AUGMENTATION  PROGRAM 


Three  major  systems  developments  or  Technology  Augmentations  were  determined 
from  several  of  the  panel's  recommendations  to  provide  significant  improvement 
in  the  registration  and  rectification  process  for  terrestrial  (or  planetary) 
imaging  systems  planned  for  launch  In  this  decade.  All  would  involve  a sig- 
nificant commitment  of  manpower  and  budget  resources  over  a 3-  to  5-year  de- 
velopment phase.  They  represent  significant  engineering,  systems,  and  scien- 
tific modeling  design  challenges  for  NASA  which,  if  accomplished,  would  serve 
a wide  community  of  research  and  applications  users.  The  recommended  systems 
include: 


I.  Advanced  Image  Registration  System:  Expanded  user  needs  in  registration 
of  multiple  sensor  data  and  more  precise  local  registration  can  best  be  met 
for  the  next  decade  by  improving  the  analyst’s  capability  to  discern  matching 
ground  control  patterns/points.  The  system  would  include  smart  imaging  ter- 
minals augmented  with  image  enhancement  algorithms  and  procedures  designed  to 
improve  an  individual  analyst's  throughput  and  success/accuracy  probability 
for  registering  multitemporal  and  multisensor  ground  control  pattern/points. 
The  system  would  also  include  automated  registration  procedures  and  selected 
projections  for  remapping  imagery  as  transportable  software  modules.  (20  man- 
years,  $500k  procurements,  5 years  duration). 

II.  Master  Ground  Control  Point/Pattern  Library  System:  Expanded  require- 
ments for  automated  ground  control  point/pattern  integration  with  imaging  sen- 
sor data  will  best  be  met  by  the  orderly  development  of  a library  that  accepts 
and  verifies  data  from  a variety  of  sources  and  is  upwardly  expandable  to  fu- 
ture sensor  systems.  The  library  would  include  the  variety  of  algorithms  re- 
quired for  testing  and  updating  ground  control  point  location  in  images  of 
different  sensors  under  different  conditions.  It  would  also  include  the  data 
archive  and  data  base  management  required  to  provide  world-wide  coverage  for 
NASA  satellite  sensor  systems.  (10  manyears,  $500k  procurements,  4 years 
duration) . 

III.  Error  Budget  Modeling  and  Sensor  Verification  Testing  System:  NASA  proj- 
ect management  needs  an  iterative  capability  to  evaluate  user  requirements  and 
potential  engineering  design  tradeoffs  prior  to  launch.  It  also  needs  a gen- 
eral purpose  end-to-end  verification  of  performance  postlaunch.  The  testing 
system  would  provide  a dynamic  environment  to  test  and  verify  alternative  reg- 
istration and  rectification  strategies  (e.g.t  use  of  GPS  for  Landsat  D)  for 
ongoing  ana  future  sensors  which  can  be  readily  understood  by  potential  users 
and  minimizing  ambiguity  associated  with  specificat ions  and  performance.  (40 
manyears,  $500k  procurements,  5 years  duration). 
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2.0  INTRODUCTION 


2. 1 BACKGROUND 

The  range  of  useful  applications  for  processed  data  have  met  initial  expecta- 
tions since  the  launch  of  the  first  satellites  two  decades  ago.  However, 
there  have  been  some  areas  of  concern  regarding  data  delivery,  the  need  for 
improved  spatial  and  spectral  resolution,  and  the  desire  for  registered  and 
map  rectified  data.  Improved  ground  systems  throughput  and  sensor  and  space- 
craft related  technology  have  shown  continuous  progress  over  the  years;  how- 
ever, the  rapid  generation  of  accurately  registered  and/or  map  rectified  data 
has  not  progressed  as  quickly.  There  are  several  reasons  that  have  contri- 
buted to  thl3  state  of  affairs,  and  they  are  the  principal  concern  of  this 
workshop. 

Remotely  sensed  data,  particularly  the  Landsat  series,  present  several  chal- 
lenges to  digital  data  acquisition.  First,  the  files  are  very  large,  requir- 
ing special  purpose  algorithms  and  hardware  for  efficient  processing.  Second, 
continuous  along-  and  across-track  distortions  in  the  imagery  — attributable 
to  sensor  geometry  and  orbit  ephemeris  cnanges  both  systematic  and  nonsystem- 
atic  — make  precise  data  capture  a difficult  and  sometimes  costly  procedure. 
Third,  NASA  experimenters  have  been  most  interested  in  the  spectral  range, 
spatial  resolution,  wide-area  coverage,  and  rapid  repeat  cycle  of  earth  obser- 
vational systems.  Only  with  time  has  an  appreciation  of  the  need  for  geocod- 
ing to  accomplish  an  easy  interface  with  other  data  sets  become  a task  of  sig- 
nificant proportions  to  warrant  a concerted  effort. 

There  have  been  several  developments  in  Landsat  data  capture  in  recent  years. 
The  mission  ground  segment  processing  has  moved  from  the  initial  photo  product 
orientation  to  a greater  concentration  on  preparing  computer  compatable  tapes. 
Improvements  have  occurred  in  both  expanding  the  number  of  frames  processed 
per  day  and  provision  for  precision  correction.  Much  work  still  s ahead, 
however,  handling  the  data  rates  and  geometric  disto-tions  associated  with  the 
upcoming  Landsat-D/Thematic  Mapper  and  proposed  MLA  systems.  In  paralle.1  with 
the  mission  ground  segment  processing  has  been  the  development  at  local  facil- 
ities of  precision  processing  of  selected  areas  to  meet  national  map  accuracy 
standards.  These  products  characteristically  overlap  other  maps  or  are  digi- 
tally interfaced  with  geographic  information  systems. 

The  workshop  was  convened  in  an  effort  to  review  Techniques  used  for  efficient 
and  accurate  registration/rectification  and  identify  key  research  areas  which 
need  to  be  addressed. 
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2.2  THE  DATA  SYSTEMS  PROGRAM 


A.  Villasenor,  NASA  Headquarters* 

The  data  systems  program  in  OSTA  has  fairly  specific  goals  that  try  to  improve 
user  access  to  space  derived  data  (see  Appendix  9*6).  In  the  process  of  doing 
that*  we  have  to  develop  data  management  activities*  put  together  catalogs  and 
provide  data  networks  to  move  data  from  the  space  producers  to  the  space  data 
users.  At  the  same  time  we  expect  to  reduce  the  cost  and  risk  of  flight  mis- 
sions. After  all,  the  primary  reason  for  flying  missions  is  to  gather  data 
and,  historically,  there  has  been  considerable  cost  in  processing  space  data. 
Also*  we  expect  to  provide  a base  whereby  providing  new  tools  and  making  data 
more  available  will  enable  *>re  questions  tc  be  asked  of  the  data  and  there- 
fore enable  new  information  capabilities.  Our  philosophy  is  to  specifically 
try  to  work  with  the  users.  We  really  don’t  have  a program  without  require- 
ments and  that’s  one  of  the  reasons  why  the  first  block  of  speakers  represents 
the  user  community.  Once  we  know  what  the  needs  are*  we  can  encourage  and  ap- 
ply advanced  technology  to  meet  their  need.  I say  "encourage"  because  the 
CSTA  role  i3  not  to  develop  technology,  it  is  to  apply  technology.  There  is 
another  office  at  Headquarters  which  is  chartered  to  develop  new  components, 
new  hardware  technologies.  What  we  want  to  do  is  serve  as  a focal  point  to 
encapsule  the  common  requirements  throughout  NASA  programs  and  have  systems 
which  can  be  transported  from  one  application  to  another.  Our  role  is  in  the 
data  system  arena  and  not  in  data  interpretation.  We  stop  at  the  point  of  ex- 
tracting specific  information,  image  classification  for  example,  and  try  to 
develop  in-house  expertise. 

A Data  Systems  Branch  role  is  to  coordinate  the  data  system  needs  which  are 
common;  the  Branch  has  the  charter  from  NASA’s  applications  office  to  develop 
a data  system  plan.  That  means  for  the  applications  projects,  common  data 
registration  activities,  common  catalogs,  and  also  pilot  system  developments. 
We  provide  technical  support  to  the  program  offices  with  respect  to  data  sys- 
tem activities.  We  try  to  apply  advanced  data  systems  technology  such  as 
pipeline  or  parallel  processors  technology  where  needed  to  improve  processing 
speeds  and  efficiencies.  We  also  need  to  establish  and  develop  a skill  base 
for  the  data  system  managers  in  the  various  NASA  flight  projects  and  establish 
a focal  point  for  NASA  interfaces  with  other  agencies  or  private  industry. 

We  have  several  programs  actively  involved  in  applying  technology  to  support 
current  and  proposed  flight  missions.  The  Application  Developmental  Data  Sys- 
tem is  to  provide  a near-real-time  processing  capability  for  Thematic  Mapper 
on  Landsat-D.  We  are  working  on  a synthetic  apperture  radar  data  system  to 
process  Seasat/SAR-type  images  in  preparation  for  future  SAR  flights.  We’re 
trying  to  transfer  some  of  the  sof tware-intensi ve  image  processing  activities 
into  the  VLSI  technology  (specifically  image  rotation).  We  are  going  to  be 
looking  ac  ligital  disk  applications  in  the  ’82-’83  time  frame.  Our  second 
thrust  is  in  networking  capabilities  and  what  we  are  doing  here  is  linking  to- 
gether a number  of  data  management  systems  and  data  analysis  facilities  which 
support  the  atmosphere  and  climate  program.  This  specifically  is  done  at  the 
Goddard  Space  Flight  Center.  A similar  activity  is  planned  for  the  Earth  Re- 
sources Program  strongly  based  on  Landsat  imagery  at  the  JSC  facility.  We 


* Edited  oral  presentation. 


just  began  this  year  to  develop  a system  for  oceanographic  research  at  Jet 
Propulsion  Laboratory. 

In  the  information  extraction  area  we  are  trying  to  build  a program;  hence, 
today's  workshop  on  image  registration/rectification.  We  will  also  be  looking 
at  data  integration  and  at  developing  executive  level  software  which  can  be 
-J i *ried  from  one  host  system  to  another.  Smart  user  terminals  are  being  de- 
v loped  at  NSTL's  laboratory.  The  intention  there  is  to  develop  low-cost  user 
terminals  for  the  market  for  the  small  user.  In  the  data  management  area  we 
* ave  evaluated  several  commercial  data  base  management  systems  with  an  appli- 
cation to  on-]ine  catalog  activities  plus  on-line  image  data  bases.  That  is 
an  activity  which  we  h?’e  begun  and  will  continue  into  the  '83  time  frame.  We 
ajso  intend  to  look  at  data  base  hardware  to  make  data  access  of  image  data 
sets  more  efficient.  There  is  a new  activity  in  '82  if  we  receive  full  fund- 
i g to  look  at  data  compression  techniques  and  some  elements  of  information 
s ience.  I know  for  example  there  are  some  questions  as  to  why  we  should 
s quire  all  of  the  possible  data  that  a sensor  generates.  Perhaps  we  can  ap- 
p.  y some  intelligence  in  either  on-board  or  ground-based  systems  to  be  more 
selective  in  acquiring  the  data  we  need.  We  alsn  look  at  modeling  elements, 
modeling  for  the  CYBER  205. 

Let  me  just  run  throu~h  the  accomplishments  to  date.  In  the  distributed  data 
systems  area  we  did  initiate  activities  in  the  ocean  pilot  at  JPL.  We've  got 
the  full  network  operation  at  Goddard  and  developed  an  on-line  catalog  for 
some  of  the  Nimbus  IZCS  data.  At  JSC,  we  developed  the  requirements  for  a 
network  of  the  earth  -esources  users.  Within  the  Atmosphere  Pilot  we  did  put 
together  medium-speei  networks  to  exchange  image  data  and  to  develop  a soft- 
ware for  exchanging  data  files,  building  upon  the  manufacturers  supplied  soft- 
ware. We  also  had  an  active  program  in  standards  for  applications  data  sets 
and  data  formats  and  protocols.  In  the  advanced  processing  systems  I did  men- 
tion the  pipeline  system  which  is  built  around  a VAX  minicomputer  with  a goal 
to  produce  ~ >0  MSS  a'd  100  TM  scenes  a day  six  months  after  launch.  In  the 
SA1  processor  we  can  now  process  a complete  SaR  digital  image  in  2-1/2  hours 
and  this  year  we  expect  to  achieve  approximately  one  hour. 

In  data  management  we  evaluated  several  systems  for  some  of  the  Pilots  and 
too*  advantage  of  the  user  requirements  for  on-line  catalogs  to  install  on- 
line interactive  inq  liries  for  the  climate  and  the  ocean  pilot  systems.  In 
the  information  extraction  area  we  started  de\ eloping  some  improved  registra- 
tion '/.echniqu at  JSC.  The  AgRISTARS  related  work  accomplished  the  capabili- 
ty to  look  at  and  register  three  multitempora 1 scenes  to  one  pixel  accuracy. 
JPL  did  ex  unsive  work  on  automosaicing  in  support  of  the  renewable  resources 
program.  The  Transportable  Applications  Exec  itive  which  Goddard  developed  is 
being  installed  in  several  computers  at  Godcard  and  JPL.  We  are  developing 
inf-  mation  extraction  software  libraries  f c r meteorology,  geology,  and  the 
o ?ans  pilot  is  working  on  a similar  package  of  algorithms  for  oceanographic 
rfork , 

The  element  i.i  the  program  on  image  regist-ation  and  rectification  requires 
attention  We  have  a very  limited  budget  and  have  to  make  some  choices  as  to 
which  center  performed  what  kind  of  activity  or  in  fact  what  made  sense  to  do. 
Our  commitment  to  support  the  user  environment  raised  a number  of  questions, 
si'd  I felt  it  was  time  for  us  to  stop  and  to  sit  down  with  experts  in  regis- 
tration and  rectification  and  try  to  develop  a program  fo**  a 5-  to  10-year 
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period.  There  are  needs  for  data  compatibility  so  that  we  can  exchange  data 
not  only  among  NASA  centers  and  between  NASA  and  industry  and  universities. 
We  need  to  look  at  data  integrity,  data  quality,  and  the  kind  of  algorithms  to 
use.  Perhaps  we  need  tc  look  at  transportable  geocoded  information  systems. 
The  use  of  the  VLSI  technology  to  solve  high-compute  algorithm  problems.  We'd 
like  to  look  at  improved  ways  to  order  and  receive  data,  and,  of  course,  we 
are  always  interested  in  low-cost  user  terminal  systems.  I wanted  to  assemble 
experts  in  industry  and  government  and  universities  to  help  identify  what  the 
user  requirements  are  and  learn  what  the  state  of  the  art  is.  Knowing  where 
we  are  today  we  can  identify  what  the  "tall  poles"  are  and  develop  a program- 
matic schedule  through  the  next  few  years.  I will  be  looking  for  specific  is- 
sues that  we  can  pursue  in  the  data  systems  program.  I expect  several  results 
out  of  the  workshop.  I expect  we  are  going  to  publish  proceedings  and  they 
will  be  distributed  by  April  and  I will  follow  that  up  shortly  with  a data 
system  program  plan. 
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2.3  WORKSHOP  RATIONALE 
f\  C.  Billingsley,  JPL» 


For  the  future,  we've  got  to  worry  about  how  we  can  actually  do  data  process- 
ing in  a manner  that  produces  data  which  is  of  greater  accuracy  by  the  time  we 
use  it.  Very  likely  we  are  going  to  be  dealing  with  a set  of  sensors  which 
may  not  be  on  a given  spacecraft.  This  says  that  the  data  may  or  may  not  be 
optimized  for  the  type  of  processing  which  we  are  going  to  apply.  This  in 
turn  gives  us  some  implications  on  the  processing  needed  prior  to  analysis, 
i c..  geographic  registration  and  the  whole  question  of  how  to  get  data  geo- 
codr'd  and  in  condition  to  register  one  set  of  data  to  the  other.  There  are 
also  questions  of  on-board  processing,  data  compression,  and  various  special 
pipeline  parallel  processor  elements  which  are  going  to  be  required  to  get  the 
data  through  the  system  in  the  reasonable  time. 


As  illustrated  by  Figure  1,  we're  dealing  with  a set  of  processing  in  one 
piece  of  this  total  system  starting  with  a sensor,  a set  that  goes  through  a 
preprocessing  step,  becomes  archived,  and  is  extracted  from  the  archive;  the 
data  is  processed  and  finally  applied  to  user  models.  We're  trying  to  put  the 
data  in  a condition  so  that  when  the  users  request  through  the  system  they  can 
get  the  set  of  data  they  want  in  the  condition  they  require. 


In  the  general  area  of  preprocessing  we  are  going  to  be  dealing  with  a number 
of  potential  topics,  among  which  is  geometric  rectification  (which,  of  course, 
is  our  main  interest  here).  The  question  of  radiometric  preprocessing  in 
terms  of  this  conference  comes  into  play  regarding  whether  or  not  the  radio- 
metric  properties  of  the  data  have  any  effect  on  our  ability  to  do  any  of  the 
geometric  operations  required.  For  instance  in  the  earlier  Landsats,  until 
the  data  were  properly  destriped,  the  correlations  which  were  done  for  regis- 
tration of  ground  control  points  tended  to  lock  in  on  a striping  rather  th^n 
on  the  data.  For  spatial  resolution,  we  are  concerned  about  frequency  re- 
sponses for  interpolation  kernels  and  what  effect  they  may  have  on  applica- 
tions. For  georeferencing  and  cataloging,  if  one  can't  find  the  data,  it 
doesn't  do  one  much  good,  Georeferencing  simply  says  that  if  we  can  register 
any  given  set  of  data  to  a reference  (I'll  call  it  a grid),  then,  implicitly, 
various  data  sets  are  "more  or  less"  registered  to  each  other  and  part  of  that 
more  or  less  is  what  we  want  to  talk  about  in  this  workshop  and  panel  ses- 
sions. What  we're  trying  to  do  is  make  the  data  correct,  make  data  sets  com- 
patible so  they  can  be  used  together,  and  eventually  make  them  available, 
which  means  put  them  in  such  a condition  that  when  we  call  for  them  from  the 
archives,  we  get  can  get  the  data  back  fairly  expediciously . 

Now  the  net  result:  the  net  use  of  the  data  in  the  long  run  is  extraction  of 
information.  Most  of  the  models  which  are  now  being  developed  required  data 
from  numerous  data  sets.  One  example  of  the  potential  interplay  of  sets  of 
data  from  various  sources  is  illustratd  in  Figure  2,  which  indicates  some  of 
the  interplays  between  data  for  a particular  problem  having  to  do  with  weather 
questions.  I don't  expect  to  go  through  this  illustration  ir  detail  except  to 
indicate  that  there  are  a lot  of  crossing  arrows  and  many  particular  processes 
that  have  to  be  modeled  in  solving  the  users  information  extraction  problem. 


•Edited  oral  presentation. 
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This  calls  for  data  from  various  sources  in  order  to  allow  multiple  users  to 
expeditiously  do  their  problem  solving. 

Use  of  various  data  3ets  together  is  one  thing,  using  data  sets  together  with 
data  from  other  sources  such  as  maps,  or  producing  data  in  which  the  required 
output  information  is  map-related  is  another.  What's  involved  basically,  is 
to  produce  a data  set  in  which  the  indiviual  data  items  in  one  form  of  geo- 
graphic coding  are  implicitly  related  to  a given  position  on  the  ground,  be- 
cause we  have  defined  where  the  entire  image  matrix  lies  on  the  ground.  Thus 
we  can  convert  latitude  and  longitude  into  a line  and  pixel  in  the  data  set. 
In  addition  to  the  question  of  using  data  sets  from  various  sources  there  is  a 
general  question  of  being  able  to  put  it  into  the  archives  and  get  it  out  of 
the  archives  in  a geographically  coded  sense,  so  that  we  can  begin  to  produce 
data  in  a form  that  will  make  that  whole  process  fairly  expeditious. 

The  requirements  involved  the  removal  of  distortions  and  then  placing  of  that 
rectified  data  in  an  archive  where  we  can  retrieve  it;  placing  rectified  data 
on  the  ground  in  a given  location  is  reviewed  in  Table  1.  This  is  not  sup- 
posed to  be  a definative  list,  but  a little  table  of  some  of  the  sources  of 
geometric  distortion.  Many  of  the  items  which  are  included  in  the  table  and 
and  figures  are  going  to  be  subjects  of  the  panel  discussions.  What  I want 
you  to  think  about  is  the  fact  that  there  are  a number  of  causes  of  distor- 
tion: some  of  them  in  the  sensor  itrcT,  some  of  them  in  the  spacecraft  in 
terms  of  its  pointing,  and  some  of  them  which  are  imp  .cit  in  a remote  sensing 
system  (such  as  the  fact  thnt  the  earth  is  round).  And  it  may  well  be  useful 
in  your  panel  discussions  to  consider  the  sequence  of  causes  of  distortions 
and  decide  whether  or  not  that  sequence  of  causes  of  distortions  gives  you  any 
clues  as  to  the  sequence  to  remove  the  distortions  and  what  might  be  done  in 
that  process.  Depending  on  which  types  of  distortions  you  are  faced  with  you 
may  treat  them  differently.  Again  these  types  of  items  and  their  specifics 
are  the  kinds  of  things  that  you  will  be  discussing  in  the  panel  meetings. 

There  are  a series  of  problems  involved  in  attempting  to  match  one  interest  to 
the  other;  I won't  try  to  go  through  those  because  you  have  a set  of  questions 
which  has  been  outlined  for  the  various  panels  as  a guide  to  thinking.  I do 
have  Figure  3,  which  will  indicate  the  type  of  problem  we  are  involved  with  in 
doing  the  correlation  of  images  to  maps.  Some  of  you  may  be  familiar  with 
this  process,  and  some  of  you  may  not,  so  I'll  indicate  it  briefly.  We  are 
trying  to  find  a piece  of  an  image  and  it's  location  with  respect  to  a map. 
We  take  each  piece  of  an  image  control  point  area,  taking  a series  of  those 
that  are  scattered  around  the  face  of  a total  frame,  then  that  series  of  ties 
between  line  and  pixel  and  the  location  on  the  ground  (latitude  and  longitude) 
gives  you  the  data  you  need  to  do  e geometrical  warping  of  the  image,  so  that 
when  you  complete  the  dewarping  process,  you  now  have  an  image  which  can  lay 
on  the  ground  — hopefully  with  all  pixels  registered.  The  essence  of  the 
process  simply  is  that  maps  and  images  do  not  cross-correlate  very  neatly  in  a 
computer,  as  maps  and  features  in  images  look  different.  We've  got  a real 
problem  in  trying  to  define  a way  to  do  that  correlation.  The  way  it  is  cur- 
rently being  done  is  to  optically  correlate,  that  is  optically  mix  and  over- 
lay, and  shuffle  around  until  they  match,  a digital  display  of  a small  piece 
of  image  and  a piece  of  a map.  When  those  two  are  optically  mixed,  then  a 
surveyed  point  on  the  map  can  be  located  in  the  small  piece  of  visual  image  by 
running  a digital  cursor  around  on  the  display  until  it  overlays  the  particu- 
lar ground  control  surveyed  point.  The  computer  would  know  where  the  cursor 
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is  in  line  and  pixel  coordinates,  and  you'll  tell  it  in  latitude  and  longitude 
where  it  is  on  the  map.  That  gives  you  a tie  between  this  little  piece  of  im- 
age, which  in  the  NASA  parlance  is  a ground  control  point  chip,  and  the 
ground.  We  know  from  the  geometry  of  the  general  situation  approximately 
where  th«.  is  in  the  incoming  frame,  so  we  pull  out  a large  piece  of  the  in- 
coming frame  digitally,  and  we  know  from  whence  we  got  it.  Now  we  have  two 
images.  Those  can  be  cross-correlated  in  a computer  more  or  less  accurately, 
and  since  we  know  the  position  of  the  surveyed  benchmark  in  the  little  piece 
of  image,  we  can  determine  through  cross-correlation  the  position  of  each  lit- 
tle piece  within  the  large  incoming  image  to  tie  the  large  incoming  image's 
line  and  pixel  with  latitude  and  longitude.  We  have  the  transfer  data  now  to 
take  that  into  the  total  frame  domain,  tie  individual  ground  control  points  to 
the  ground,  and  develop  the  equations  needed  for  the  entire  image.  That's  the 
kind  of  process  we  currently  go  through.  It  requires  building  a library  of 
ground  control  points  ahead  of  time,  so  when  the  incoming  frames  come  we  can 
do  this  cross-correlation  expeditiously  on  the  way  through  the  system,  two- 
hundred  frames  a day.  Anything  that  people  can  think  of  during  the  workshop 
to  improve  the  process  will  be  appreciated. 

The  process  that  I described  for  ground  control  points  requires  that  that  par- 
ticular control  point  be  known  in  x,  y,  and  z altitude,  and  the  basic  dewarp- 
ing is  normally  a process  of  fitting  a best-fit  plane  through  that  set  of 
ground  control  points.  That's  fine,  but,  as  you  know,  in  hilly  country  there 
are  intermediate  points  in  the  image,  which  may  or  may  not  be  on  that  same 
plane.  If  you  have  hills  or  valleys  in  between,  they  are  going  to  be  dis- 
placed by  a distance  which  is  a function  of  the  angle  from  which  you  are  view- 
ing those  particular  points,  i.e.,  the  relief  displacement  question.  I worked 
up  a little  graph  (Figure  H)  which  shows  that  relief  displacement  is  larger 
than  you  like  to  believe  when  you  are  dealing  with  pixels  of  the  Thematic  Map- 
per size.  In  particular,  although  a repeat  visit  over  a given  area  on  the 
ground  is  intended  to  be  a new  image  from  precisely  the  same  point,  in  prac- 
tice that  would  not  be  true.  It  will  be  from  some  other  point  nearby.  And 
the  question  is  how  bad  does  that  slight  displacement  displace  pieces  of  the 
image  which  are  not  on  the  same  best  fit  plane.  Well,  here  is  the  net  result 
when  you  scale  the  Thematic  Mapper  pixels.  It  says,  that  with  a surprisingly 
small  difference  in  elevation  between  a given  local  point  and  the  best  fit 
plane,  with  a surprisingly  small  separation  of  the  two  vantage  points  (and  re- 
membering that  the  scatter  of  repeat  visits  on  a given  point  is  in  the  neigh- 
borhood of  5-10  km),  there  is  a fairly  large  displacement  potentially  of  pix- 
els which  are  not  on  that  original  plane.  Even  though  you  have  a good  fit  to 
normal  control  points,  you  may  or  may  not  have  some  other  problems  in  areas  of 
high  relief.  In  particular  with  Landsat,  the  overlap  area  from  side  to  side 
is  a 170-km  line  of  displacement  between  the  wings  of  paraoverlap  images  from 
adjacent  tracks.  We  are  going  to  get  a fair  amount  of  displacement  distortion 
due  to  elevation  alone. 

While  there  are  a number  of  other  items  which  we  could  talk  about,  I think 
that  is  enough  to  give  you  the  flavor  of  the  kinds  of  problems  that  we  see 
coming  up:  potential  areas  of  distortion,  potential  areas  of  lack  of  regis- 
tration of  the  images  to  the  ground.  There  are  a number  of  specific  questions 
which  have  been  outlined  for  the  various  individual  panels  and  you  will  get 
your  crack  at  thinking  about  these  and  some  of  the  other  topics  as  you  get  in- 
to the  panel  discussion. 
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Figure  1.  Technological  Comnor.ents  And  Issues  Of  Total  Information  System  Structure 
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3.0  PANEL  RECOMMENDATIONS  AND  SUPPORTING  DISCUSSION 

3.1  CHARGE  TO  THE  PANELS 

For  each  panel,  the  six  following  items  were  requested.  Appendix  9.**  provides 
a complete  listing  of  materials  provided  to  initiate  panel  discussions.  Each 
panel  was  able  to  respond  to  most,  if  not  all,  of  the  requests. 

a.  Develop  a position  statement  on  the  state  of  the  art  for  those  ele- 
ments in  applications1  techniques  of  concern  to  this  subpanel  for  the 
registration/rectification  of  imaging  sensor  data.  Use  the  paper  pre- 
sented as  a point  of  departure,  adding  new  elements  neglected  and  delet- 
ing elements  of  little  concern  to  NASA  and  the  user  community. 

b.  Develop  a position  statement  on  anticipated  requirements  for  those 
elements  in  applications1  techniques  of  concern  to  this  subpanel  for  the 
registration/rectification  of  imaging  sensor  data.  Use  the  paper  pre- 
sented as  a point  of  departure,  adding  new  elements  neglected  and  delet- 
ing elements  of  little  concern  to  NASA  and  the  user  community, 

c.  Outline  the  current  status  of  the  technology  within  NASA.  List  the 
centers  of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d.  Propose  experiments  that  should  be  conducted  to  test  document  areas 
of  concern  to  this  panel  in  technique  applications.  This  should  include 
synthetic  and  standardized  data  sets. 

e.  Discuss  the  feasibility  of  providing  tested  software  systems  pack- 
ages to  implement  standard  procedures  presently  developed.  Recommend 
candidate  systems  for  the  "registration  processors"  survey. 

f.  Identify  research  tasks  that  the  subpanel  fee11  should  be  pursued 
to  enhance  near-  and  medium-range  capabilities.  Rec  ;nm end  levels  of  ef- 
fort (manyears,  dollars)  and  task  duration.  Prioritize  the  research 
tasks. 
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3.2  REPORT  OF  SUBPANEL  ON  IMAGE  SHARPNESS 

The  image  sharpness  subpanel  met  for  a four-hour  period  on  November  18  and 
again  for  four  hours  on  November  19  to  define  research  needs  it:  this  subject 
area  for  earth  resource  observation  systems.  The  panel  consisted  of: 


Bob  Barker 
Bill  Shelley 
Bill  Alford 
Or back  Zvi 
Marvin  Maxwell 
Arch  Park 
Jack  Engel 
Demetrios  Poros 
Joseph  Kundholm 
Peter  Hyde 


St.  Regis  Paper  Co. 

St.  Regis  Paper  Co. 
NASA/Goddard 
Honeywell  E.0.0. 
NASA/3SFC,  Code  920 
G.E.  Lanham,  Md. 

Santa  Barbara  Pesch.  Ctr . 
G.E.  Lanham,  Md . 

NASA/GSFC 

Un.  of  Md  . Cmptr  .Sci  .Ctr . 


The  format  for  the  subpanel  given  as  a starting  point  was  followed  in  the  ini- 
tial discussions,  but  as  time  was  short,  it  was  decided  to  focus  on  the  task 
descriptions  and  the  expected  costs.  The  required  items  are  included  here  to 
the  extent  they  were  discussed  and  further  information  is  to  be  added  later. 


3.2.1  Definitions 


Initial  discussion  considered  the  definitions  of  the  various  functions  and 
parameters  defining  the  sensor  scene  viewing  process.  Conflict  with  existing 
definitions  occurred  throughout  and  no  consensus  could  be  reached  in  the  short 
time  without  adequate  references.  The  panel  adopted  the  conventions  that  are 
described  and  used  in  NASA  SP-335,  Advanced  Scanners  and  Imaging  Systems  For 
Earth  Observations.  Special  reference  is  made  to  the  section  entitled  "Reso- 
lution Improvement  Considerations"  on  pages  89  through  103  and  on  the  section 
entitled  "Definitions  Pertaining  to  Resolution  and  Sample  Data"  on  pages  105 
through  iu9. 

PSF  - Point  Spread  Function:  blur  due  to  optical  element?  in  system 

IFOV  - Instantaneous  Field  of  View:  aperture  width  in  scanner  sensor  system 

EIFOV  - Effective  Instantaneous  Field  of  View:  composite  blur  function  after 

filter  effects,  PSF,  end  IFOV  have  been  combined. 

These  are  really  working  definitions  to  allow  panel  members  to  separate  the 
blur  components  of  the  sensor.  They  are  not  to  be  widely  applied,  figure  1 
depicts  these  steps.  It  was  natural  to  have  the  thinking  focus  on  multispec- 
tral  scanners  and  not  on  all  the  sensors  which  are  of  interest.  These  other 
sensors  include:  Imaging  Synthetic  Aperture  Radar  (SAR),  Separate  Thermal  IR 

Images  (HCMM),  Multispectral  Linear  Array  (MLA).  The  MLA  contains  unique 
characteristics  which  set  it  apart  from  the  scanning  optics  of  TM  and  MSS,  so 
it  is  called  out  separately. 

3.2.2  State  of  Knowledge 

The  parameters  defining  the  state  of  the  art  in  sharpness  were  discussed  but 
not  quantified.  It  was  generally  assumed  that  TM  was  the  state  of  the  art  in 
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multispectral  scanners  and  the  digitally  processed  SAR  was  state  of  the  art  in 
radar.  Order  of  magnitude  numbers  are  included  in  some  cases. 


Sensor:  Atmospheric  Blur/Scatter  Function 

Optical  PSF 
Scanner  Aperture 
Filter  Characteristics 
Sample  Rate 
Quantization 
Ground  Processing: 

Effects  of  Resampling  on  Sharpness 
Sharpening  Filters  Much  work 

Sharpness  Effects  on  Classification 


30  re 

30  m 
8 bits 

cubic  convolution 
done  but  not  used 
a few  studies 


Atmospheric  Connection 


A few  users  doing 


3.2.3  Requirements 


Discussion  initially  focused  on  whether  sharpness  was  to  oe  considered  from 
the  standpoint  only  of  registration  or  of  impacts  on  classification  as  well  as 
registration.  It  was  decided  that  unusual  sampling  rates  would  be  needed  in 
the  future  to  enable  improved  sharpening  of  images  through  deconvolution. 
Present  sampling  rates  are  too  low  to  allow  much  improvement.  Severe  noise 
effects  arise  even  when  moderate  improvement  is  attempted.  Requirements  were 
cited  for  sharpening  in  the  context  of  forestry  applications:  a)  resolution  of 
mixed  (edge)  pixel  problem  (improved  classification  precision,  reliable  change 
detection  results,  more  precise  areal  estimates);  b>  improved  rectification 
(improved  definition  of  manually  located  GCP  locations,  verification  of  carto- 
graphies). 

3.2.4  Recommended  Research  Tasks 

Several  key  researen  tasks  were  proposed  and  are  listed  here: 

I.  Study  of  Relationships  of  IOVF  or  Performance  of  Matching:  Unenhanced, 
raw  data  is  being  used  for  template  matching  in  major  image  geocorrection  sys- 
tems (e.g.,  MDP).  Sharpening  processes  appear  to  produce  more  visual  detail. 
This  apparent  sharpness  could  reduce  position  errors  in  template  matching. 
Various  sharpening  techniques  should  be  applied  to  images  before  matching. 
Since  nonlinear  processes  are  used  for  matching,  usuol  linear  analysis  cannot 
be  used.  Performance  should  be  measured  by  experiments  with  real  data. 

II.  Conduct  a study  to  determine  the  "optimum"  shape  for  the  Effective  In- 
stantaneous Field  of  View  (EIFOV)  and  the  sampling  lattice  to  allow  the  gener- 
ation of  an  Output  I FOV  (0EIF0V)  in  the  sharpening  or  resampling  operation 
which  is  "optimized"  for  various  applications  such  as  photomap  generator,  mul- 
titemporal multispectral  classification,  etc.  In  the  study  the  variations  in 
EIFCV  shape,  size,  and  sample  spacing  in  x and  y will  be  construed  to  keep  the 
system  cost  approximately  constant  by  keeping  the  number  of  detectors  or  the 
data  rate  constant. 


III.  Optical  Profilterting : t'e  proposed  to  research  the  advantage  of  an  op- 
tical filter,  to  filter  the  image  data  before  it  reaches  the  "detector  array." 
It  seems  that  for  a system  like  MLA,  where  the  image  data  is  sampled  by  a dis- 
tinct detector  array,  an  antialiasing  optical  low-pass  filter  can  be  very 
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helpful.  In  fact,  an  antialiasing  filter  for  such  a system  can  only  be  an  op- 
tical filter.  It  also  seems  that  such  an  optical  low-pass  filter  may  be  more 
easily  achieved  than  time-domain  electronic  low-pass  filters.  Therefore  we 
recommend  that  a research  be  established  to  evaluate  the  needs  and  the  prac- 
tical feasibility  of  an  optical  low-pass  filter  for  an  image-sampling-type 
camera  in  order  to  avoid  aliasing. 

The  sampling  theory  states  that  in  a sampling-type  system,  a prefilter  is  re- 
quired to  avoid  aliasing. 


I.a.  Original  signal  l.b.  The  signal  after  ideal 

low-pass  filter  of  fs/2 


2. a.  Original  signal  2.b.  Filtered  signal  after 
after  sampling  and  sampling  and  reconstruction 
reconstruction 

(an  = aliasing  noise) 


As  it  is  described  by  Figures  la,  1b,  2a,  and  2b,  the  sampling  theory  states 
that  if  the  sampling  rate  is  fs.  the  output  has  no  frequency  content  above 
fs/2,  or  the  input  will  appear  as  aliasing  noise  at  the  output.  Sampling  sys- 
tems in  the  time  domain  are  very  common  today.  In  practice,  a project  time- 
type  low-pass  filter  cannot  be  achieved,  and  so  a lot  of  systems  use  oversam- 
pling to  avoid  aliasing  noise.  The  new  generation  of  ground  observation 
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imaging  devices  like  MLA  use  a detector  array  approach.  Such  a system  is  im- 
age sampling  and  obeys  the  sampling  theory.  As  such,  any  spatial  frequencies 
greater  than  the  half-sampling  frequency  will  appear  at  the  detector  output  as 
an  alaising  noise.  At  that  point  the  removing  of  the  noise  from  the  real  im- 
age is  hardly  possible.  It  then  seems  that  the  image  data  should  be  filtered 
before  it  is  sampled  by  the  detector  array.  Such  a filter  could  only  be  opti- 
cal. It  also  seems  that  a spatial  optical  low-pass  filter  can  better  achieve 
the  ideal  performance  since  the  whole  data  exists  instantaneously  as  opposed 
to  time  type  of  filtering.  When  the  signal  from  t=-ootot=+oo  cannot 
be  available  to  the  filter,  the  optical  filter  then  should  be  part  of  the  op- 
tical subsystem  used  to  bring  the  image  data  to  the  detector  array.  A re- 
search should  be  established  to  evaluate  what  kind  of  benefit  would  come  out 
of  an  optical  filter  in  front  of  the  detector  array  imaging  devices.  The  per- 
formance of  a low-pass  optical  filter  should  be  studied.  The  problem  of  dif- 
ferent optical  bands  should  also  be  considered.  The  final  result  of  such  re- 
search should  be  the  requirements  for  a low-pass  optical  filter  for  a specific 
detector  array,  and  whether  or  not  such  filter  is  cost  effective  at  all. 

IV.  Utilization  of  DOD  Capabilities  by  NASA 

An  effort  should  be  made  to  establish  the  state  of  the  art  on  the  capability 
of  the  Department  of  Defense  and  the  intelligence  community  to  produce  image 
processors  for  sharpening  (also  resampling  and  feature  extraction),  to  estab- 
lish if  their  techniques  could  be  useful  to  civilian  applications.  Efforts 
could  then  be  made  to  nave  this  information  declassifed  and  made,  available 
through  publication  in  the  open  literature. 

V.  Investigation  of  Effects  of  Diffraction 

Appropriate  compensation  (sharpening)  techniques  need  t be  developed  for  use 
on  data  in  which  the  dominant  cause  of  the  image  blur  is  dafraction.  Advanced 
Thermal  IR  MLA  sensors  and  passive  microwave  sensors  will  be  "Defractor 
Limited."  Study  should  be  conducted  to  establish  the  technique  that  would  be 
used  and  the  performance  improvement  to  be  expected  as  a function  of  the  scene 
characteristics. 

VI.  SAR  Image  Sharpening 

Research  activity  in  support  of  synthetic  aperture  radar  (SAR)  must  he  identi- 
fied, but  there  was  no  member  of  the  panel  with  real  experience  in  SAP  pro- 
cesses or  interpretation.  These  tasks  should  be  addressed  later  with  appro- 
priate people  providing  the  needed  inputs. 
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3-3  REPORT  OF  SUBPANEL  ON  FEATURE  EXTRACTION* 

The  feature  extraction  panel  met  during  two  sessions  to  define  research  needs 
in  this  subject  area  for  earth  resource  observation  systems.  The  panel  con- 
sisted of: 


Mr.  Doug  Carter 
•JSGS 

Mr.  Michael  Rassbach 
Elogic,  Inc. 

Dr.  Thomas  Lynch 
NASA/GSFC 


Mr.  R.  Kent  Lennington 
Lockheed 

Mr.  John  T.  Dalton 
NASA/GSFC 


Dr.  Ray  Wall 
JPL 


Ms.  Ruth  Whitman 
OR  I 


Dr.  Robert  Haralick 
Virginia  Polytechnic  Institute 


3.3.1  State  of  Knowledge 

There  are  three  issues  in  the  subpixel  feature  estimation  problem:  1)  the 
identification  of  image  models  which  adequately  describe  the  data  and  the  sen- 
sor it  is  using,  2)  the  construction  of  local  feature  models  based  on  those 
image  models,  and  3)  the  important  problem  of  trying  to  understand  these  ef- 
fects of  preprocesing  on  the  entire  process.  We  identified  two  classes  of  im- 
age models  for  subpixel  feature  estimation  which  we  thought  were  worthwhile 
pursuing.  We  don't  want  to  give  the  impression  we  thought  that  those  were  the 
only  two,  but  in  terms  of  both  what  we  heard  from  Bob  Haralick  and  the  experi- 
ence of  the  people  on  the  panel,  we  first  distinguished  techniques  based  on 
surface  fitting  which  have  underlying  assumptions  about  continuity  and  defer- 
entiability  of  the  intensity  surface;  these  people  tend  to  do  their  analysis 
on  a pixel-by-pixel  basis,  without  any  direct  concern  for  the  overall  organi- 
zation of  features  of  edges  and  lines  to  form  long  straight  lines  with  smooth 
curves  in  the  picture.  This  was  opposed  to  what  might  be  called  structural 
models,  which  essentially  accommodate  geometrical  models  which  describe  the 
shape,  size,  and  arrangement  of  pieces  in  a picture,  and  statistical  models, 
which  tell  you  about  the  ways  in  which  they  are  colored.  These  second  types 
have  been  distinguished  from  surface  fitting  models  in  terms  of  computations 
by  the  fact  that  the  feature  detection  is  done  more  on  the  basis  of  analyzing 
local  neighborhoods  to  take  advantage  of  the  information  in  the  geometric  mo- 
del. For  example,  assume  that  a picture  is  piecewise  constant  upon  the  edges 
between  piecewise  constant  regions  to  better  than  a pixel.  That  doesn't  pre- 
clude combinations  of  these  approaches  or  others,  but  we  certainly  think  it’s 
important  that  people  pay  serious  attention  to  this  problem  of  being  very  spe- 
cific about  exactly  what  models  they  are  using  to  describe  the  images  and  ex- 
actly what  the  local  feature  models  are  that  they  are  using  to  estimate  the 
location  of  these  local  features. 


Another  topic  which  we  felt  deserves  some  attention  here,  is  integration  of 
these  features  into  high-level  descriptions  of  content  in  the  image.  Some  ex- 
amples, in  case  people  aren't  sure  what  we  were  talking  about,  include  line, 
curve,  and  intersection  detection,  shape  detection  for  specific  classes  of 
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shape  that  might  be  important,  deriving  information  about  the  topology  of 
areas  in  the  picture,  and  more  generally,  segmentation  techniques  based  upon 
construction  of  local  features.  It  is  important  to  note  that  the  analysis  of 
the  effect  of  preprocessing  on  these  local  feature  estimation  techniques  is 
going  to  vary  from  sensor  to  sensor. 

The  development  of  ground  control  point  libraries  for  automated  selection  pre- 
sents two  concerns.  One  is  the  organization  of  these  GCP  libraries  for  recti- 
fication problems,  i.e.  the  problems  of  automatically  selecting  by  compute* 
the  specific  GCP’s  for  particular  registration  tasks.  Of  concern  are  the 
types  of  things  that  have  to  be  contained  in  the  description  of  any  one  of 
these  patterns,  because  we  were  looking  for  more  general  representations  that 
you  can  find  in  pictures  besides  just  a range  of  spectral  information  say  de- 
rived from  a particular  sensor  in  a particular  time  to  represent  that  pattern 
for  matching  for  all  other  times.  Second  is  the  importance  of  integrating 
ground  control  patterns  in  a data  base  management  system,  so  that  you  can  in- 
terface to  a large  number  of  sensor  image  types  with  an  automatic  selection 
system. 

In  terms  of  problems  of  operational  and  experimental  validation,  the  issues 
include  choosing  appropriate  simulated  and  real-image  and  ancillary  data,  and 
being  able  to  establish  validation  criteria,  to  compare  different  techniques, 

3.3.2  Recommended  Research  Tasks 

We  spent  much  of  our  time  trying  to  establish  a set  of  priorities  in  each  one 
of  these  areas.  Figures  1 and  2 summarize  our  conclusions.  In  the  local  fea- 
ture detection  area  we  felt  that  priorities  should  lie  with  the  construction, 
design,  and  development  of  image  and  feature  models.  A second  priority  ought 
to  be  the  actual  data-set  selection  and  the  design  of  operational  validation 
techniques.  A third  should  be  investigation  of  these  feature  integration  mech- 
anisms again;  that  is,  compute  more  structural  description  of  image  patterns 
and  put  together  the  results  of  these  local  analyses.  Then  fourth,  the  ef- 
fects of  preprocessing  on  feature  detection  should  be  considered. 

The  other  major  topic  was  ground  control  point  library  priorities.  Here,  we 
felt  that  the  first  thing  that  needs  to  be  looked  at  is  what  the  content  would 
be  of  such  a library.  Would  it  be  an  extended  version  of  what’s  planned  to  be 
made  available  now,  in  terms  of  including  standard  types  of  chips  you  have 
now,  or  things  like  chain  codes  of  shapes,  information  about  texture  and  spec- 
tral content?  A second  effort  should  be  creating  an  automatic  selection  sys- 
tem for  a single  sensor  (based  around  a data  base  management  system,  feasibil- 
ity study  in  that  area).  A third  possibility  is  dynamic  ground  control  pat- 
tern libraries;  the  idea  here  being  that  as  you  use  chips  over  and  over  again, 
you  begin  to  collect  information  about  not  only  the  reliability  of  particular 
points  for  rectification,  but  also  information  on  the  what  patterns  would  be 
derived  from  map  information  only.  Thus,  when  you  start  looking  at  different 
types  of  sensors,  and  try  to  use  these  patterns  to  rectify,  you  can  collect 
information  about  the  actual  spectral  properties  on  the  ground  for  that  type 
of  sensor.  Furthermore,  you  can  integrate  that  into  the  definition  of  that 
chip  and  use  it  for  subsequent  selections.  Then  a fourth  priority,  a much 
longer  range  task,  is  to  look  at  the  feasibility  of  multisensor  systems  that 
have  a much  larger  data  base.  Here  we  have  to  really  face  up  to  the  problem 
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of  whether  or  not  you  really  can  effectively  construct  patterns  which  can  be 
used  across  sensors. 

In  Figure  3 we  tried  to  show  course  approximations  to  times  that  should  be  al- 
located to  these  tasks  and  their  ordering  in  time;  i.e.,  which  one  can  over- 
lap, and  which  necessarily  proceed  others  for  logical  or  cost  reasons. 
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IMAGE  AND  FEATURE  MODELS 
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6CP  LIBRARY  DESIGN  AND  DEVELUPMENT/TEST ING 
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FIGURE  3-  TIME  FRAME 


I — — LU  LU 

* — — * s: 


Od 

LU  C O 
C£  LU  Z 
D I-  ^ 
I-  2 7) 
<1  — 00 
UJ  LU 

U-  I O 
^ OO  O 
id  -i  ac 
L3  uJ  O- 
< Q U 
^ O m 
— SI  Q- 


CVI  (sr\  LH 

OO  00  oo  CO 

<T>  CT>  CT) 

i—H  «— H 


32 


1986 


>•  W82'  28703 


i 


3. 4 REPORT  OF  THE  SUBPANEL  ON  INTER-IH*  MATCHING 


The  Inter-image  matching  panel  met  for  two  sessions  to  define  research  needs 
in  this  subject  area  for  earth  resource  observation  systems.  The  panel  con- 
sisted of: 


Mr.  H.  K.  Ramapriyan 
NASA/GSFC 

Mr.  R.  Bryan  Erb 
JSC 

Ms.  June  Thormodsgard 
USGS 

Mr.  Jerry  M.  Cantril 
Computer  Sciences-Technicolor 

Mr.  Frederick  W.  McCaleb 
NASA/GSFC 


Mr.  Donald  Brandshaft 
Santa  Barbara  Research  Center 

Mr.  Paul  F.  Maynard 
Earth  Satellite  Corporation 

Mr.  Terry  Silverberg 
U of  MD 

Mr.  Richard  Sigman 
Department  of  AgricuJ  ture 

Professor  Laveen  Kanal 
U of  MD 


Mr.  George  Austin 
Lockheed 


The  survey  paper  prepared  by  R.  Wolfe  and  R.  Juday  provided  a good  overview  of 
the  state  of  the  art  and  requirements.  The  panel  concentrated  upon  developing 
the  design  of  and  rationale  for  research  efforts  in  this  area. 

3.4.1  Recommended  Research 

Six  research  areas  were  identified  by  the  panel  and  are  described  below: 

I.  Correlation  Considerations 

The  issues  to  be  addressed  under  this  topic  are  those  relating  to  matching 
small  sections  of  images  (or  information  derived  from  images)  to  other  images 
(or  map-derived  information).  We  recommend  considering  the  following  topics: 
a)  types  of  correlation  algorithms,  b)  preprocessing  techniques,  c)  limits  on 
subpixed  accuracy,  d)  relief  and  atmospheric  refracticn  effects, 
e)  evaluation  of  success  rate,  f)  evaluation  of  accuracy. 

We  are  aware  of  various  matching  and  preprocessing  techniques  as  indicated  in 
the  survey  paper.  However,  a study  is  still  needed  to  compare  these  from  the 
points  of  view  of  interactions  among  them  and  their  effects  on  accuracy  of 
matches.  A study  should  be  made  of  the  theoretical  limits  on  the  subpixed  ac- 
curacy that  can  be  achieved  given  that  the  images  are  sampled  data.  The  va- 
lidity of  techniques  used  for  estimating  "subpixel  offsets”  (e.g.,  surface 
fitting)  for  matching  maps  should  be  examined.  The  effects  of  relief  and  at- 
mospheric refraction  on  the  image-matching  process  should  be  quantified,  es- 
pecially in  relation  to  higher  resolution  sensors.  Techniques  should  be  de- 
veloped for  estimating  probabilities  of  image  matching  success,  false-alarm 
and  miss  rates. 
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The  correlation  techniques  to  be  considered  should  include  "nonraster"  data 
types*  Extraction  of  image  features  to  match  with  "digital  map"  representa- 
tions should  be  considered  due  to  its  potential  for  a common  data  base  for 
multiple  sensors.  Different  data  types  may  require  different  algorithms. 
Both  sensor  data  correlation  and  the  reGuired  preprocessing  should  be  studied. 
A tradeoff  study  should  be  made  to  find  the  optimum  combination  of  preprocess- 
ing correlation  and  surface  fitting  for  offset  estimation  in  relation  to  vari- 
ous sensor  types  (resolution,  spectral  characteristics,  geometries),  ground 
characteristics,  and  imaging  seasons. 

If  correlation  techniques  guaranteeing  successful  image  matching  are  not 
available  and  verified,  the  specifications  such  as  the  Thematic  Mapper  equip- 
ment of  .3  (relative)  and  .5  (absolute)  accuracy  cannot  be  met.  It  has  been 
shown  that  hard  specifications  such  as  these  imply  high  ground  system  costs. 
Therefore  it  is  necessary  to  establish  realizability  of  such  accuracies  so 
that  we  either  not  be  as  stringent  with  the  specifications  and  let  users  "live 
with"  the  errors,  or  come  up  with  techniques  for  achieving  and  verifying  the 
accuracies.  Multisensor  image  matching  and  image  to  nonimage  data  matching 
techniques  have  the  potential  of  saving  the  effort  needed  in  building  multiple 
control  point  libraries. 

Items  a through  d listed  below  constitute  a coherent  group.  The  prioritiza- 
tion should  be  in  terms  of  theoretical  work  and  he  experiments  to  be  per- 
formed on  various  sensor  types,  data  types,  etc  The  sequence  of  events 
should  be  as  follows:  a)  create  a common  software  brary  to  be  shared  among 

researchers;  b)  perform  theoretical  studies  of  : pixed  accuracies,  relief 

distortions  and  atmospheric  refraction  effects;  c)  identify  sensor  types  and 
experimental  data  sets  (synthetic  and  real)  to  be  u:  ed ; d)  conduct  tests  of 
technicians  and  trade  off  studies. 

II.  Study  to  determine  interaction  of  inter-image  matching  procedures  and  se- 
lection of  GCPs  for  a given  sensor. 

The  types  of  GCPs  which  should  be  selected  for  future  libraries  will  most 
likely  depend  not  only  on  the  characteristics  of  the  GCP,  but  also  on  the 
matching  procedures  in  which  the  GCPs  will  be  used.  For  remote  sensing  data 
from  a given  sensor,  an  experimental  design  with  the  following  analysis  ele- 
ments is  proposed:  a)  preprocessing  procedure  analysis,  b)  inter-image  match- 

ing factors  analysis  (correlation  measure,  correlation  peak  determination, 
match  reject/ accept  criteria),  c)  GCP  factors  analysis  (type  of  GCP,  season 
and  scene  characteristics  of  base  chip,  season  and  scene  characteristics  of 
test  chip) . 

Within  each  factor  combination,  chip  pairs  with  knov;n  image-to- image  matches 
(determined  manually)  will  be  subjected  to  the  processing  factors.  Measured 
response  data  for  the  experimental  design  will  be  matches  and  summary  statis- 
tics (average,  dispersion,  percentiles)  of  the  difference  between  true  offset 
and  automatically  determined  offset  for  nonrejected  matches,  and  measures  of 
the  temporal  stability  of  matching  performance.  TTie  benefits  of  the  above  de- 
scribed study  are  that  the  study  conclusions  will  provide  guidance  in  selec- 
tion of  GCPs  for  future  libraries.  The  penalties  for  not  performing  the  study 
is  that  future  GCP  libraries  will  be  built  but  will  have  low  success  rate  in 
automatically  registering  data. 


III.  Global  multisensor  control  point  library  feasibility  study. 

If  ground  control  points  are  to  be  used  to  rectify  and/or  register  future  re- 
motely sensed  image  data,  the  feasibility  of  a highly  automated,  global,  mul- 
tisensor control  point  library  should  oe  determined.  Such  a system  should  in- 
corporate improved  methods  of  loading  control  points,  improved  user  access 
(including  the  capability  for  users  to  interactively  load  their  own  control 
points  from  remote  terminals),  standard  contrcl  point  formats,  and  a multi^en- 
sor  data  base. 

A global  multisensor  control  point  library  would  reduce  the  operational  costs 
associated  with  precision  rectification  and  registration  of  future  sensor  sys- 
tems, In  addition,  the  capability  for  users  to  load  special  sets  of  GCPs  and 
access  the  GCP  library  allows  the  user  to  guarantee  the  rectification  8nd/or 
registration  accuracy  of  specific  data  sets  of  interest  to  him. 

The  initial  capital  outlay  to  implement  such  a system  would  probably  be  in  ex- 
cess of  million.  In  addition,  multisensor  registration  may  well  not  be 
easy  to  achieve. 

IV.  Multiple  Control  Point  Considerations 

Elevation  of  observed  control  point  mismatches  to  an  image-level  mismatch 
characterization  is  effected  by  fitting  a distortion  function  to  the  GCP  off- 
sets. This  distortion  function  could  arise  from  (1)  inadequacy  in  £ priori 
definition  of  the  geometrical  model  (e.g.,  not  including  scan  anomalies,  ter- 
rain effects,  atmospheric  differential  refraction,  etc.),  (2)  from  an  incom- 
plete characterization  of  its  form  (e.g.,  role  is  modeled  as  third-order  in 
time  but  the  dota  is  first  order),  or  (3)  the  case  that  the  a priori  model  is 
properly  characterized  but  with  imprecise  parameters  (e.g.,  polynominal  coef- 
ficients are  refined  with  GCP  data).  Characterization  of  the  model  dictates 
the  optimal  sizing  and  placement  of  control  points.  The  possibility  of  unde- 
tected GCP  outliers  (i-e.,  erroneous  matches)  dictates  the  need  for  estimation 
techniques  beyond  conventional  least  squares. 

The  proposed  research  would  investigate  the  effect  of  number  and  distribution 
of  control  points  required  aa  an  effect  of  image  (sensor)  characteristics  ade- 
quacy of  fit  to  an  a priori  model  or  selection  of  degree  or  model  for  warping 
function  in  an  adaptive  sense.  The  adaptive  capability  will  reduce  the  number 
of  correlations  required  for  mapping  well  ordered  data  sets  and  consequently 
“■he  processing  time  or  equipment  complexity  while  extending  tne  capability  to 
nandle  diverse  data  sets  at  limited  througnput  rates. 

The  following  specific  areas  are  recommended:  a)  Investigate  spatial  distor- 
tion filtering:  derive  new  techniques  or  expand  existing  techniques,  e.g. 
Kahlman  filtering;  b)  Test  polynomial  rubber  sheeting  in  terms  of  compromise 
between  order  selection  and  reducing  RMS  error;  c; Investigate  application  of 
robust  estimation  techniques  to  rubber-sheeting  and  to  fitting  a priori  forms; 
d)  Investigate  adaptive  placement  of  control  points,  e.g.,  to  effect  minimum 
RMS  fit  errors;  e)  Investigate  magnitude  of  high-frequency  geometrical  dis- 
tortions vatmospheric  distortion,  sensor  anomalies)  and  control  point  aizing; 
f)  Investigate  methods  to  overcome  geometrical  distortions  with  a GCP  patch. 
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Candidate  methods  include  iterative  registration  (correlate,  remap,  recorrel- 
ate, remap,  etc.)  and  application  of  the  affine/Fourier  technique  of  Emmert 
and  McGillam  to  determining  the  offset  in  an  affinely  distorted  GCP. 

V.  Centralized  System  Study 

A trade-off  study  needs  to  be  undertaken  that  considers  the  optimal  hardware 
configuration  for  image  production  of  data  derived  from  different  sensor  types 
with  emphasis  on  software/hardware  tradeoff  for  balanced  computation  and  I/O. 
Of  particular  interest  is  the  read  to  determine  feasibility  of  developing  a 
centralized  system  to  perform  registration  and  rectification  for  various  sen- 
sors (i.e.,  SAR,  MLA,  MSS,  etc.).  Development  of  a centralized  system  could 
be  the  most  economical  and  efficient  approach  to  meet  future  image  processing 
requirements. 

VI.  User  System  Studies 

By  using  a combination  of  systems  analysts,  a survey  of  user  experience,  and 
experimental  tests,  it  should  be  possible  to  determine  the  speedup  factors  a 
user  can  expect  by  using  commercially  available  special  purpose  hardware  such 
as  array  processors  and  bulk  core  memory.  It  should  also  be  possible  to  de- 
termine whether  it  is  economical  to  speed  up  commonly  used  algorithms  by  using 
simple  custom  electronics.  This  study  would  assist  users  in  hardware  systems 
design. 

3.4.2  Research  Priorities 

Priorities  fo>"  the  proposed  research  are  subdivided  in  Figures  1 and  2 into 
near-  or  long-term  tasks.  The  elements  listed  are  subsets  of  the  six  recom- 
mended research  areas. 
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TYPES  OF  CORRELATION  ALGORITHMS 
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3.5  REPORT  OF  THE  SUBPANEL  ON  REMAPPING  PROCEDURES 


The  remapping  procedures  subpanel  met  for  two  sessions  t~  define  research 
needs  in  remapping  for  earth  resources  observational  systems.  The  panel  con- 
sisted of: 


Howard  S.  Heuberger 
NASA/GSFC 

Stephen  G.  Ungar 

Goddard  Institute  for  Space  Studies 

Victor  Conocchioli 
EROS  Data  Center 

Christine  Hlavka 
NASA/ARC 


Dave  Nichols 
JPL 

Bert  Guindon 
Canada 

M.  Naraghi 
JPL 

Phil  Cressy 
NASA/GSFC 


Edward  Mikhail 
Purdue  University 


A1  Zobrist 
JPL 


3.5.1  State  of  Knowledge 


Remapping  is  done  by  government  data  centers,  private  industry,  and  users. 
Systems  developed  by  government  data  centers  (e.g.,  MDP)  deliver  a few  types 
of  products  which  do  not  meet  the  range  of  needs  of  users.  The  need  for  sub- 
sets and  mosaics  of  frames,  map  quadrangles,  various  map  projections,  etc. 
were  documented  at  the  1977  Santa  Maria  Conference  on  Geobase  Information  Sys- 
tem Impacts  on  Space  Image  Formats.  A value-added  private  industry  service 
has  not  developed  because  there  is  little  available  software  and  it  is  not 
profitable  for  a company  to  fund  remapping  software  efforts.  Users  typically 
develop  bits  and  pieces  of  remapping  software  as  needed.  All  three  types  of 
organizations  would  benefit  from  a fundamental  research  effort  on  remapping 
software  and  systems  which  achieve  a range  of  products  and  are  modular  and 
transportable.  Related  research  is  needed  in  areas  of  platform  modeling  and 
calibration  and  photogramme trie  methodology  for  current  and  proposed  senrors 
including  spaceborne  and  airborne.  Table  I summarizes  key  problems  facing  the 
space  image  data  user  community  today. 

It  was  noted  by  the  panel  that  the  remapping/rectification  process  could  be 
significantly  aided  through  engineering  systems  improvements  in  attitude  con- 
trol, with  subsequent  improvement  in  spacecraft  ephemeris  modeling  accuracy. 
Attitude/alignment  error  is  the  largest  source  of  image  rectif icator,  error. 
Thermally  induced  relative  alignment  error  between  the  image  instrument  and 
the  spacecraft  must  be  measured  or  actively  compensated  for.  An  alternative 
is  to  place  the  attitude  sensors  in  close  proximity  to  the  image  instrument  to 
minimize  misalignment  effects.  It  was  noted  that  attitude  error  can  be  con- 
trolled to  3b  seconds  with  current  generation  star  trackers  and  hydro.  A star 
tracker/hydro  package  capable  of  3 seconds  accuracy  could  be  developed.  Fur- 
thermore, an  ephemeris  accuracy  of  10  meters  is  possible  witn  the  NAVSTAR/GPS 
system.  With  the  GPS  system  it  would  appear  we  will  achieve  150-^00  meter  ac- 
curacy in  the  absence  of  ground  control  points.  This  can  be  contrasted  with 


TABLE  I.  Problems  in  Remapping 


o MANY  USERS  DESIRE  PRODUCTS  IN  MAP  PROJECTED  FORM  AND  USUALLY  IN  QUADRAN- 
GLES ORIENTED  NORTH 

o REMAPPING  SOFTWARE  IS  NOT  TRANSPORTABLE/ EFFICIENT 
o GCP  LIBRARY  NOT  DISTRIBUTED 

o QUALITY  CONTROL  ON  STANDARD  PRODUCTS  (E.C-.  , MDP)  NOT  SUFFICIENT 

o SENSOR/PLATFORM  MODELS  ARE  NOT  COMPLETELY  UNDERSTOOD  OR  UTILIZED 

0 PHOTOGRAMMETRIC  RECTIFICATION  MODELS  FOR  SINGLE  AND  MULTIPLE  IMAGES  NOT 
WELL  DEVELOPED 

o MODEL  CALIBRATION  DAIA  ARE  INADEQUATE 

0 RECTIFICATION  ACCURACY  LIMITED  BY  INADEQUATE  KNOWLEDGE/AVAILABILITY  OF 
TERRAIN  RELIEF  DATA 


the  10-15  meter  accuracy  possible  without  GCPs  but  using  advanced  attitude 
sensors  and  misalighment  compensation  and  measurement  on  the  next  generation 
spacecraft, 

3.5.2  Recommended  Research 

The  research  tasks  recommended  are  summarized  in  Table  II. 

There  is  a need  for  state-of-the-art  technology  assessments  prior  to  initia- 
tion of  major  programs,  and  the  high  potential  return  from  well  formulated 
testing  of  algorithms  on  selected  data  sets  of  actual  and  synthetic  imagery. 
In  addition,  there  is  a need  for  SRT  tasks  that  incorporate  standard  photo- 
grammetric  methodology  and  formulas  and  that  more  fully  utilize  platform  and 
calibration  data  from  current  and  proposed  sensors  to  reproject  digital  imag- 
ery. The  impact  of  improved  platform  stability  and  integration  of  GPS  mea- 
surements on  reduced  ground  segment  processing  needs  to  be  critically  as- 
sessed. The  group  also  highlighted  the  need  for  a substantial  effort  in  the 
development  of  remapping  software  and  systems  that  are  modular  and  transport- 
able. This  need  steins  from  the  fact  that  previous  and  current  ground  segment 
image  data  rectification  tasks  are  faced  with  external  forces  difficult  to  re- 
solve, namely  users  wanting  a wide  variety  of  map  projections  and  data  pro- 
cessing capabilities  which  private  industry  has  not  yet  cost-effectively  de- 
veloped nor  has  an  individual  government  facility  efficiently  supplied. 
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TABLE  II. 

RECOMMENDED  RESEARCH  TASKS 
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TABLE  II  (Continued) 
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TABLE  II  (Continued) 
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3*6  REPORT  OF  THE  SUBPANEL  ON  RESAMPLING  FUNCTIONS 

The  resampling  functions  subpanel  met  in  two  four-hour  sessions  on  November  18 
and  19  to  djfine  research  needs  in  this  area  for  earth  resource  observation 
systems.  The  panel  consisted  of: 


Richard  hiday 

Lee  Bender 

NASA/JSC 

US3S 

Arun  Prakash 

Scott  Cox 

General  Electric 

NASA/GSFC 

Allan  Mord 

Robert  H.  Dye 

Ball  Aerospace 

ERIM 

Henry  Muse 

Roger  A-  Holmes 

E-Systems  Inc. 

General  Motors  Institute 

Paul  Heffner 

David  Dow 

NASA/GSFC 

N ASA/NSTL 

Carter  Glass 
Goodyear  Aerospace 

3*6.1  State  of  the  Art 

The  state  of  current  practice  in  resampling  appears  limited  to  the  use  of  lin- 
ear filters,  usually  cubic  convolution  on  nearest  neighbor.  Less  frequently 
used  alternatives  are  bilinear  and  least  squares  filters.  Nearest  neighbor  is 
usually  the  choice  when  low  cost  is  important  or  when  it  is  believed  that  oth- 
er methods  degrade  the  data.  Resampling  functions  are  established  on  incom- 
plete theory.  Cubic  convolutions,  for  example,  is  based  on  a sine  function 
but  does  not  employ  statistical  noise  characteristics.  There  are  several  dif- 
ferent bases  for  determining  the  cubic  convolution  parameters.  It  is  un- 
settled as  to  the  "optimum”  set  of  parameters. 

Several  important  points  related  to  resampling  ^ere  brought  up.  The  term  "re- 
sampling" is  not  clearly  defined.  A universally  agreed  upon  "figure  of  mer- 
it" does  not  exist.  Communications  between  disciplines  which  enter  the  re- 
sampling problem  from  different  directions  and  with  different  terminology  is 
confused.  Cubic  convolution  can  not  be  used  to  fill  image  pixel  gaps.  The  TM 
uses  spine  weights  for  this  purpose.  Nonlinear  filter  technique^  *re  reported 
in  the  literature  but  do  not  appear  to  be  used  extensively  in  the  civilian  re- 
mote sensing  community. 

3.6.2  Anticipated  Requirements 

Improvements  in  the  use  of  resampling  in  applications  of  remote  sensing  will 
require  development  of  a sound  theoretical  and  philosophical  basis  predicated 
on  argueable  cost,  error,  or  benefit  criteria.  Two  reasonably  distinct  areas 
of  resampling  usage  are  identifiable,  with  different  levels  of  difficulty  in 
theoretical  development.  Spatially  periodic  and  complete  input  lattices  of 


sampled  points  to  be  resampled  to  periodic  output  lattices  of  point  values  de- 
scribes the  more  tidy  area  of  resampling.  Input  lattices  which  are  irregular, 
including  such  phenomena  as  missing  points,  missing  lines,  skew  from  one  line 
subset  to  another  (TM  extended  line  problem  or  MLA  sudden  yaw  or  pitch  prob- 
lem) , attitude  warp,  and  bow-tie  or  other  mapping  distortions  pose  a more  dif- 
ficult area  with  significant  overlap  with  registration  and  rectification  tech- 
niques, When  such  sound  bases  are  established,  the  applications  field  will 
require  a portable  set  of  standard  resampling  codes  featuring  various  known 
levels  of  affordability  in  time  and  money  and  well-designed  linkages  with  ar- 
chival data  annotation  blocks. 

The  wide  range  of  potential  applications  and  expanded  needs  for  resampling 
versatility  in  new  imaging  sensors  leaa*  to  a concern  for  creating  standard- 
ized test  data  sets  and  ground  training  sites.  The  following  steps  need  to  be 
taken:  a)  We  need  to  develop  synthetic  data  sets  related  to  specific  disci- 

plines. b)  Data  sets  based  on  actual  measurements  should  be  tightly  con  • 
trolled  both  geometrically  and  radiometr ical ly . Information  concerning  the 
creation  of  the  data  set  should  be  made  universally  obtainable.  For  aircraft 
acquired  scanner  data,  extensive  pre-  and  postflight  performance  evaluations 
should  be  undertaken,  c)  Ground  training  sites  used  for  evaluation  of  vari- 
ous sensor  types  and  processing  functions  should  be  extensively  mapped  and 
photographed.  Updates  at  reasonable  intervals  are  mandatory,  d)  Experiments 
involving  registration  and  rectification  req  ire  precise  geometric  and  geo- 
detic control,  sites  should  be  surveyed  to  present  cadastral  standards.  An- 
cillary recorded  data  such  as  DTM,  soil  type,  etc.  should  be  made  available  at 
a grid  size  smaller  than  the  expected  IFOV  or  spaceborne  sensors.  One  order 
of  magnitude  smaller  is  desirable. 

With  respect  to  resampling  algorithms,  the  possibility  exists  to  construct  a 
library  of  tested  algorithms  available  from  NASA/Cosmic  or  an  alternate 
source.  In  pursuit  of  this  goal,  standards  need  to  be  developed  with  respect 
to:  a)  transportability,  b)  documentation  (should  include  the  mathematical 

basis  of  the  algorithm  as  well  as  a thorough  description  of  the  algorithm  it- 
self), c)  test  data  sets,  and  d)  standardized  performance  specifications. 

3.6.3  Recommended  Research 

Seven  research  areas  were  identified  by  the  panel  and  are  described  below. 

I.  Perfo.m  a study  research  task  to  develop  a theory  for  defining  an  input 
psf  of  an  instrument  such  that  upon  resampling  of  the  processed  data  into  the 
desired  output  grid  the  radiometric  and  geometric  properties  are  a best  esti- 
mate of  the  true  upwell^ng  radiances.  Such  a theory  would  include  noise,  de- 
sired output  psf,  and  application  specific  best  estimate  parameter. 

II.  Develop  algorithms  for  estimating  missing  data  or  for  ignoring  missing 

d^ta.  Such  missing  oata  sources  to  be  considered  are:  a)  dead  detectors  in 

multiscanners  (including  MLS s) , b)  scanner  sweep  gaps,  c)  transmission  drop- 
outs. Such  algorithms  should  be  characterized  by  their  effect  on  the  output 
image  such  that  the  choice  of  procedure  can  be  made  by  the  user  for  the  appli- 
cation being  considered. 

III.  Per* form  a study  on  optimal  resampling  functions.  These  optimal  func- 
tions may  be  application  specific  or  determined  for:  a)  radiometric  accuracy. 


b)  geometric  fidelity,  c)  spatial  feature  enhancement  and  extraction.  Ques- 
tions to  be  addressed  include  the  nature  of  data  characteristics  which  permit 
such  optimality  and  what  kind  of  trade-offs  are  made  between  the  different 
kinds  of  optimal  filter  and  under  what  conditions  can  an  optimal  filter  be  de- 
signed to  be  optimal  for  both  radiometric  accuracy  and  geometric  fidelity. 

IV.  Standard  Data  Sets.  The  choice  of  a resampling  function  is  problem  de- 
pendent, For  a complex  problem,  the  specific  effects  of  a given  resampling 
function  cannot  be  predicted  by  pencil-and-paper  methods.  As  a result,  a 
two-stage  simulation  with  standard  data  sets  is  recommended.  3oth  real  and 
synthetic  data  sets  are  required  because  there  are  really  two  functions  to  be 
performed.  The  synthetic  data  set  can  be  used  to  study  the  behavior  cf  vari- 
ous resamplers  on  controlled  data.  We  can  derive  various  figures  of  merit  for 
comparing  filter  performance  and  add  controlled  amounts  of  noise  to  study 
noiue-re jection  performance.  Synthetic  data  exhibits  the  following  properties: 
(a)  ability  to  control  dimensionality,  (b)  power  spectral  density,  (c)  type 
and  magnitude  of  noise,  and  (d)  features,  etc.  An  authentic  data  set  is 
needed  to  give  the  final  level  of  credibility  to  the  resampler  performance. 
Real  data  is  essential  to  uncover  phenomena  which  cannot  be  anticipated  by  ar- 
tifically  contrived  data.  Real  data  should  represent  the  problem  ("Typical" 
scene  or  even  "worst-cast"  scene).  The  synthetic  data  set  lends  itself  well 
to  determining  quantitative,  controlled  performance  measures.  The  real-data 
set  lends  itself  to  qualitative  (visual)  comparison  and  discovery  of  gross 
processing  artifacts. 

V.  The  least  squares  resampler  developed  by  Dye  should  be  further  developed 
and  tested.  Cost  benefit  analyses  must  also  be  done  and  clear  definitions  of 
of  applicability  and  limitations. 

VI.  There  is  a need  for  merit  functions  for  assessing  resampling  techniques. 
Various  numbers  and/or  functions  have  been  proposed  as  measures  of  goodness  of 
resampling  operations.  Confusion  exists  regarding  the  relationships  between 
them  and  what  they  measure.  People  expect  that  different  end  users  will  need 
to  optimize  different  figures  of  merit,  but  aren’t  quite  sure  which.  The  re- 
search approach  would:  a)  List  and  define  all  candidate  merit  functions. 
Perform  theoretical  analysis  to  find  the  relationship  between  them  and  what 
information  they  convey,  b)  Survey  users  in  various  disciplines  to  see  which 
merit  functions  look  most  useful  to  each.  c)  Compute  all  promising  merit 
functions  for  one  or  two  examples  of  resampling.  Focus  on  exploring  the  merit, 
functions,  not  the  resampling. 

VII.  Develop  a benign  resampling  algorithm.  Present  "A  to  P"  conversion  for 
Landsat  D imagery  introduces  problems  in  the  "P"  data  that  makes  some  users 
undertake  the  conversion  themselves,  or  wish  they  could.  Modern  pipeline  pro- 
cessors may  make  some  sort  of  A to  P conversion  strongly  attractive,  provided 
that  a kernal  can  be  found  which  does  not  damage  the  data  unacceptably.  Re- 
search should  be  undertaken  to  analyze  resampling  althorithms  to  find  ones 
which  retain  nearly  all  of  the  quality  of  the  data  originally  collected  while 
doing  rubber  sheet  resampling  plus  filling  small  fixed  gaps.  Characterize  it 
in  terms  of  suitable  merit  functions.  Design  algorithms  to  be  implemented  in 
fast  hardwired  processor.  Demonstrate  feasibility  on  real  data. 
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3.7  REPORT  OF  THE  SUBPANEL  ON  ERROR  CHARACTERIZATION  AND  ERROR  BUDGETS 


The  sub;  .nel  on  error  characterization  and  error  budgets  met  in  two  sessions 
during  November  10  and  19,  1982.  The  panel  consisted  of: 

Dr.  John  L.  Barker  Mr  Arthur  J.  Fuchs 

NASA/GSFC  NaSA/GSFC 


Hr.  Charles  J.  Finley 
NASA  Headquarters 

Dr.  Joseph  L.  Bishop 
NASA  Headquarters 

Dr.  'wiiliam  F.  Case 
NASA/GSFC 

Mr.  John  M.  Driver 
JPL 

Col.  Alden  P.  Colvocoress 
USGS 


Hr.  Eric  Beyer 
General  Electric 

Hr.  Willi an  Pictrowski 
NASA  Headquarters 

Mr . Ken  Ando 
NASA  Headquarters 

Dr.  Roy  Welch 
University  of  Georgia 

Mr.  Fred  Billingsley 
JPL 


Mr.  Frank  Wong 

MacDcnald-Detweiier  Associates 


The  ultimate  objective  of  this  end-to-end  error  anarysis  program  is  to  maxi- 
mize the  utility  of  the  data  to  the  user  by  mininuzirg  the  overall  positioning 

error  in  a cost  effective  manner.  For  existing  land  remote  sensing  systems, 

such  as  Landsat-D,  this  implies  measuring  and  isolating  the  key  components  of 
error  in  order  to  predict  errors  in  inferred  output  variables,  and  to  modify, 
if  necessary,  mission  operations  and  ground  processing  procedures.  For  future 
systems,  such  as  possible  multisensor  multiresource  missions,  error  analysis 
starts  by  modeling  and  predicting  the  Key  error  sources  and  sensitivity  in 
systems  performance  for  specific  products  in  order  to  assist  in  the  design, 
fabrication  and  trade-off  phases.  The  methodology  for  tms  error  analysis 

must  be  in  place  during  the  study  phase  of  future  systems  in  order  to  fully 

examine  both  hardware  and  software  approaches  to  meeting  requirements. 

The  report  is  organized  into  two  sections.  The  first  reviews  our  current 
state  of  knowledge  of  both  user  positioning  requirements  and  error  models  of 
current  and  proposed  satellite  systems.  The  second  section  gives  a broad  out- 
line of  the  subpanel  recommendations.  In  addition,  there  are  two  appendices. 
Appendix  A details  the  implications  of  an  assumption  that  a strawman  1 ’24,000 
scale  mapping  requirement  might  be  the  criticsl  driver  for  an  operational  land 
observing  system.  Appendix  B is  a listing  of  subpantl  members. 

3.7.1  State  of  Knowledge 

3.7. 1.1  User  Requirements 

Analysis  of  extensive  user  surveys  on  spatial  and  spectral  requirements  for  an 
operational  land  observing  system  have  recently  been  completed  (Barker  et  al. 
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1980) .  There  is  little  if  any  information  in  these  surveys  to  quantitatively 
justify  any  specific  positioning  requirement.  This  is  an  indication  of  the 
need  to  provide  for  iterative  interaction  with  informed  technical  and 
professional  users  since  a significant  mapping  requirement  was  not  antici- 
pated. Furthermore,  the  majority  of  potential  users  of  map  quality  digital 
imagery  would  not  have  been  surveyed  because  neither  they  nor  the  surveyers 
recognized  the  applicability  of  satellite  data  to  mapping.  There  were  con- 
sistent requirements  for  2-m  data  for  foresters  and  others  in  the  USDA.  The^e 
requirements  are  about  the  same  size  as  those  needed  to  meet  the  most  impor- 
tant mapping  requirement  of  1:24,000  (Barker,  1980)  which  was  identified  in  a 
separate  initial  study  of  mapping  requirements.  Informal  queries  on  foreign 
maps  indicate  that  a scale  of  1:50,000  is  probably  the  one  most  generally 
used.  Actual  requirements  for  mapping  from  future  sensors  are  part  of  an  on- 
going study  under  the  ELOS  activities  at  Goddard  Space  Flight  Center  (ERIM, 

1981) .  Appendix  3-7. A details  the  implied  requirements  for  a strawman 
1:24,000  scale  map. 

3.7.1.?  Generic  Error  Source  Modeling 

Spacecraft  systems  need  accurate  characterization  for  error  budget  development 
to  accuracies  commensurate  with  cartography  to  NMA  standards  at  1:24,000 
scale.  Analytic  orbit  propagators  are  not  yet  adequate  to  meet  the  need.  As- 
suming a minimal  use  of  ground  control  points  in  the  image  registration  pro- 
cess, the  accuracy  standards  delineated  in  tne  following  paragraphs  must  be 
met. 

Ephemeris  measurement  capability  commensurate  with  GPS  capability  (10-m  posi- 
tion) is  essential  for  geodetic  positioning  adequate  to  satisfy  the  stated 
user  need.  The  operational  processing  of  GSTDN  (Goddard  Space  Tracking  and 
Data  Network)  data  and  the  projected  processing  of  TDRSS  data  do  not  provide 
these  accuracies. 


Knowledge  and/or  control  of  platform  dynamics  to  better  than  0.001  deg  point- 
ing accuracy  and  10~6  deg/s  pointing  stability  is  needed  for  adequate  geodetic 
position  accuracy.  Landsat-D  pointing  control  with  0.01  deg  pointing  control 
and  10“^  deg/s  stability  represents  the  present  state  of  the  art  for  nadir 
oriented  platforms. 


Sensor  dynamics  have  been  modeled  to  a significant  extent  for  the  scanning 
type  instruments  as  discussed  below  under  "Existing  Geometric  Error  Analys. 
Models  for  Landsat-D". 


HLA  and  SAR  do  not  present  any  obvious  dynamics  problems  and  no  significant 
analyses  have  been  done  to  date.  However,  the  need  for  continuous  alignments 
to  a few  arc  seconds  do  not  allow  ruling  out  the  need  for  such  analyses.  Al- 
so, pointable  imagers  such  as  may  characterize  an  0L0S  will  certainly  necessi- 
tate analyses  with  regard  to  pointing  dynamics  and  view  angle  aberrations. 
Preliminary  effects  of  view  angle  are  indicated  by  Driver  (1982). 

Error  sources  not  subject  to  control  such  as  earth  rotation,  curvature,  and 
topographic  variability  have  significant  impact  on  potential  geodetic  position 
accuracy  and  must  be  modeled  and  compensated  for  error  minimization. 


Surface  velocity  and  image  configuration  on  a rotating  triaxial  ellipsoid  must 
be  modeled  and  analyzed  and  methods  sought  for  error  minimization. 


Ground  control  pattern  utilization  is  common  for  obtaining  high-accuracy  geo- 
detic position.  However,  this  is  a costly  and  slow  method  for  image  registra- 
tion and  rapidly  becomes  untenable  for  rapid  repeat  coverage  or  a global 
scale,  particularly  for  inadequate  a priori  estimate  of  geodetic  position. 
Furthermore,  adequate  ground  control  does  not  exist  in  many  parts  of  the 
world.  Tentative  error-compensation  options  have  been  advanced  for  the  major 
sources  (Driver,  Significant  work  is  needed  to  determine  the  feasibil- 

ity of  such  compensation  options  or  others  which  will  enable  acquisition  of 
images  with  inherently  accurate  geodetic  position  on  a global  scale.  The 
projected  5-10  year  time  scale  for  the  development  of  a TM  GCP  (Ground  Control 
Point)  library  indicates  that  future  sensor  systems  of  high  spatial  resolution 
rnu^t  place  a greatly  reduced  reliance  on  GCPs. 

3.7. 1.3  Existing  Geometric  Error  Analysis  Models  for  Landsat-D 

A number  of  error  analysis  models  and  simulations  currently  exist  for  the 
Landsat-D  TM  image  processing.  These  techniques  can  be  categorized  into  TM 
sensor,  attitude  measurement,  attitude  control,  spacecraft  structural  dynam- 
ics, Systematic  Correction  Data  Generation,  and  control  point  error  dynamics. 

The  TM  sensor  models  include  a dynamic  simulation  of  the  TM  scan  mirror  assem- 
bly (including  open  loop  and  closed  loop  structural  interaction  effects),  a 
scan  line  corrector  dynamic  simulation,  and  a TM  optical  model  which  categor- 
izes off-axis  pointing  of  each  detector  as  a function  of  detector  location  and 
optical  misalignments. 

TOe  attitude  measurement  models  include  jitter  response  (above  0 .01  Hz)  and 
models  of  the  Attitude  Control  DRIRD  (gyro.'  and  the  angular  Displacement  Sen- 
sors (ADS).  These  models  are  incorporated  i o a simulation  which  imparts  at- 
titude motion  into  the  sensors,  processes  tne  aata  through  prototype  Attitude 
Data  Processing  software  and  evaluates  the  accuracies  of  the  processing  sys- 
tem. This  simulation  is  used  to  determine  the  effects  of  DRIRU  or  ADS  cali- 
bration error  on  overall  system  performance. 

The  attitude  control  model  is  a detailed  simulation  of  the  Attitude  Control 
System  and  low-frequency  (less  than  7-Hz)  structural  dynamics.  Included  in 
this  simulation  are  effects  of  the  solar  array  drive  and  TDRSS  antenna  drive. 
This  model  has  been  used  to  estimate  the  attitude  control  pointing  accuracy 
and  the  low-frequency  spacecraft  jitter. 

The  structural  dynamics  model  is  a detailed  NASTRAN  model  of  the  Landsat-D 
spacecraft  from  which  modal  analysis  is  performed.  This  model  has  been  veri- 
fied by  performing  component  modal  tests  of  the  TL.1SS  Antenna  and  boom,  the 
solar  array,  the  Instrument  Module  Center  body  (including  TM  and  MSS  Mass  Sim- 
Pulators),  and  Mul titnission  Spacecraft.  This  model  is  used  to  predict  on  or-- 
bit  high-frequency  (greater  than  or  equal  to  7-Hz)  jitter  caused  by  the  TO  and 
MSS  mirror  impacts. 

The  accuracy  of  Systematic  Correction  Data  Generation  is  tested  by  comparing 
the  outputs  of  prototype  software  to  those  of  a high  precision  earth  look 
point  and  map  projection  models. 
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The  control  point  error  dynamics  analysis  include*  an  19-state  covariance  an- 
alysis and  a detailed  simulation  of  control  point  location  errors  (this  simu- 
lation is  currently  in  development).  The  covariance  analysis  and  simulation 
include  dynamic  error  models  for  ephemeris,  alignment,  and  low-frequency  atti- 
tude. The  covariance  analysis  has  been  used  for  system  studies  to  determine 
processing  feasibility  and  the  simulation  will  be  used  to  test  the  operational 
control  point  processing  software. 

In  addition  to  the  above  error  analysis,  the  effects  of  gap  resampling  have 
been  studied  using  simulated  TM  edge  responses  and  small  sections  of  analyti- 
cally generated  TM  imagery.  The  entire  resampling  processing  has  been  devel- 
oped in  a prototype  software  simulation  which  includes  a bit-by-bit  emulation 
of  the  resampling  hardware. 

It  must  be  noted  that  these  analysis  models  and  simulations  are  not  currently 
deliverable  software  packages.  They  are  analysis  tools  used  by  General  Elec- 
tric to  design  and  analyze  the  TM  processing  system. 

3.7*2  Recommendations  For  Position  Error  Modeling  Research 

Fo  ir  specific  recommendations  were  made  by  the  panel  in  the  limited  time  they 
haa  to  collectively  discuss  the  issues.  These  are  summarized  below  and  are 
discussed  in  more  detail  in  Sections  2.1  thru  2.4.  In  addition,  a very  pre- 
liminary assessment  was  made  by  several  of  the  panel  members  of  the  resources 
that  may  be  required  to  carry  out  the  recommended  research.  Due  to  lack  of 
time  at  the  workshop,  the  full  panel  was  not  able  to  be  consulted  onto  the  re- 
quired resources. 

The  recommendations  are: 

1.  Obtain  and  evaluate  the  existing  error  models  for  Landsat-D/TM  (see 
Section  2.1  for  discussion).  Expected  resources  required:  $0.5M 

over  3 years  with  5 MY  civil  service. 

L.  Provide  iterative  user  involvement  in  system  error  budgeting  and  er- 
ror model  development  and  verification  on  real  and  synthetic  data 
sets  (see  Section  2.2  for  discussion).  Expected  resources  required: 
$2.0M  over  5 years  with  20  MY  civil  service. 

3.  Develop  error  models  for  future  system  definition  and  trade-off  stu- 

dies on:  a)  sensors  (MLA  Advanced  scanner  SAR)  b)  spacecraft/shut- 
tle c)  processing/informat  ion  (see  Section  2.3  for  discussion) . Ex- 
pected resources  required:  $0.5M  over  j years  with  5 MY  civil 

service. 

4.  Create  a Positioning  Error  Budget  Study  Group  (see  Section  2.4  for 
discusoion)  Expected  resources  required:  $0.1M  over  j years  with  2 MY 
civil  service. 

3.7.2. 1 Needed  Geometric  Error  Analysis  Model  for  TM 

A number  of  potential  error  models  may  be  needed  to  more  fully  cnaracterize  TM 
sensor  and  processing  errors.  These  include: 
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o A TM  dynamic  structural  model  to  evaluate  the  critical  rigid  body  as- 
sumption between  the  ADS  mounting  location  and  the  TM  optical  axis. 

o Effects  of  topological  variation  resulting  from  the  orbit  and  attitude 
control  on  the  Landsat-D  geodetic  and  temporal  registration  accura- 
cies. Examination  of  the  feasibility  and  desirability  of  developing 
and  appending  a quantitative  measure  of  topographic  variability  within 
a TM  scene  as  a direct  or  surrogate  estimate  of  misplacement  of  pixels 
within  the  scene  due  to  topography. 

o Analyses  of  the  correlation  location  accuracy  which  can  be  expected 
from  TM  resolution  imagery. 

RECOMMENDATION  - Obtain  and  evaluate  the  existing  TM  processing  error  models. 
This  may  require  upgrades  of  the  software  documentation  to  deliverable  status. 

3. 7. 2. 2 Create  Interactive  User  Involvement  In  System  Error  Budgeting  and 
Modeling  and  Verification  on  Real  Data  Sets 

User  "requirements"  have  been  solicited  from  a variety  of  users,  generally 
without  consideration  of  costs  of  obtaining  them,  without  verbalized  consider- 
ation of  any  losses  in  utility  if  they  are  not  met,  and  without  verbalized 
consideration  of  parameter  tradeoffs.  This  prevents  the  system  engineer  or 
scientist  from  being  able  to  iterate  potential  system  designs  with  the  users. 

To  solve  this  problem,  it  is  recommended  that  specific  efforts  be  planned  to 
involve  the  users  iteratively  in  the  generic  development  of  error  budget  meth- 
odology prior  to  and  during  the  mission  designs. 

One  possible  mechanism  for  facilitating  cooperative  involvement  of  the  user 
and  system  engineer  in  the  translation  of  user  requirements  into  system  per- 
formance specification,  subsystem  allocations,  error  budgets,  and  error  models 
would  be  the  use  of  mission  system  analytical  models  which  are  capable  of 
producing  an  output  which  simulates  the  actual  data  that  the  user  would  get 
from  the  mission.  A capability  could  be  generated  for  processing  undistorted 
input  ucx_nes  (real  and  synthetic)  and  creating  distorted  output  scenes  in  the 
users  data  format.  The  analytical  processing  would  be  done  using  system  mod- 
els for  the  mission  and  would  include  distorting  estimates  due  to  all  sources 
of  error  that  the  platform,  instrument,  and  ground  and  flight  data  processing 
systems  woj  d introduce.  In  the  early  stages  of  mission  definition  and  in- 
strument conceptual  design,  these  analytical  studies  could  be  based  on  simple 
models  of  the  mission  and  the  distortions.  As  the  instrument  and  mission  de- 
sign form*  up,  the  models  and  analysis  could  be  updated  and  take  on  more  com- 
plexity if  required.  If  the  models  also  contained  representatives  of  the  oth- 
er electro-cptieal  imaging  characteristics  of  the  instrument,  the  analysis 
would  produce  an  output  image  containing  representations  of  all  radiometric, 
spatial,  and  geodetic  instrument  data  degradations.  A byproduct  of  tnis  ca- 
pability would  be  that  analytically  produced  data  products  would  be  obtained 
which  could  be  used  to  aid  in  the  design  and  testing  of  ground  data  processing 
systems.  The  expected  result  of  an  effort  to  produce  this  overall  mission 
analytical  simulation  would  be  to  provide  a systematic,  highly  visible,  inter- 
active approach  for  establishing  optimum  instrument  performance  specifications 
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and  error  budgets  which  could  also  be  used  to  assess  expected  instrument  sys- 
tem performance  including  ground  data  processing  algorithms. 


Before  embarking  on  extensive  data  collection  schemes,  however,  a study  should 
be  conducted  to  see  if  synthetic  scenes  can  contribute  to  the  understanding  of 
positioning  errors  for  future  systems. 

3. 7. 2. 3 Identify  Strawman  Mission  For  Modeling  Key  Error  Sources  And  Identify 
Hardware  and  Software  Methods  For  Minimizing  Errors 

In  order  to  identify  the  hardware  and  software  technology  needed  to  obtain  the 
registration  and  rectification  requirements  expected  of  advanced  spaceborne 
imaging  systems,  complete  end-to-end  system  trade-off  studies  need  to  be  per- 
formed. These  can  be  accomplished  by  identifying  several  strawman  missions 
which  are  expected  to  drive  image  rej.istration/rectification  technology  and  by 
performing  system  studies  on  these  missions.  The  system  studies  would  identi- 
fy the  error  budgets  for  the  mission*  which  would  include  errors  due  to  the 
orbit,  platform,  3ensor  dynamics,  scene  variability,  as  well  as  errors  intro- 
duced aue  to  any  processing  of  data  on-board  or  on  the  ground.  Trade-off 
studies  could  then  be  performed  using  system  registration/rectification  models 
for  the  missions  with  all  sources  of  error  modeled.  Trade-offs  involving 
hardware  and  software  improvements  for  positioning  error  minimization  could  be 
made  in  the  areas  of: 

1.  Platform  attitude  and  ephemeris  measurements/estimation/control 

2.  Instrument  pointing  and  alignment  measurement/estimation/control 

3.  On-board  or  ground  processing  of  the  data,  including  GCPs.  To  regis- 
ter and  rectify  the  images  both  within  one  mission  data  set  as  well 
as  with  other  data  sets. 

3.7.2. 4 Develop  Error  Models  for  Future  System  Definition  and  Trade-off 
Studies 

3. 7. 2. 4.1  Sensors 

a)  MLA:  The  MLA  sensor  operates  in  an  integrating  mode  where  the  cross-track 

scene  is  simultaneously  imaged  with  fixed  geometry  and  perspective.  Unlike  a 
scanner,  any  spacecraft  or  sensor  induced  jitter  or  other  disturbance  will  af- 
fect all  detectors  equally.  No  pixel-to-pixel  high-frequency  jitter  correc- 
tion will  be  necessary. 

The  fixed  nature  of  the  detectors  and  the  simultaneous  imaging  in  the  crots- 
track  direction  should  substantially  reduce  the  processing  required  to  produce 
geometrically  correct  images. 

Studies  should  be  conducted  to  investigate  the  geometric  effects  which  are 
unique  to  an  MLA-type  sensor  and  its  impact  on  rectification.  One-dimensional 
dewarping  algorithms  to  simplify  geometric  rectification  and  the  residual  er- 
rors resulting  from  attitude  and  ephemeris  uncertainties  should  be  investi- 
gated. In  order  to  realize  the  advantage  of  the  smaller  pixels  and  higher  re- 
solving capability  provided  by  an  MLA  sensor,  concurrent  improvements  in  the 
capabilities  of  the  spacecraft  attitude  and  ephemeris  system  will  be  required. 
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Models  and  sensor  simulations  need  to  be  developed  to  investigate  and  identify 
the  trade-offs  between  sensor  ACS  and  ephemeris  determination  improvements  and 
sensor  performance  for  various  pixel  size.  Semiempirical  models  of  the 
sensor/spacecraft  interface  including  dynamic  effects  should  be  developed  to 
determine  whether  some  form  of  active  jitter  or  image  motion  compensation  will 
te  needed  tc  realize  the  10-m  baseline  resolution  of  MLA. 

A potential  pushbroom  sensor  containing  a central  segment(s)  of  higher  resolu- 
tion end  segments  could  provide  the  possibility  of  obtaining  high-recolution 
data  for  mapping  and  ground  control  point  location  concurrently  with  acquisi- 
tion of  the  "normal1'  multispectral  data. 

The  added  high-precision  data  allows  the  possibility  of  minimizing  geometric 
errors  related  to  ground  point  locations  (as  well  as  providing  the  possibility 
for  subpixel  texture  information).  This  also  provides  data  which  can  be  used 
to  iterate  spacecraft  attitude  models,  at  higher  precision  than  would  the  nor- 
mal lower  resolution  data. 

b)  Advanced  Scanner:  Scanning  instruments  such  as  MSS  and  TM  create  unique 
problems  with  error  budgeting  and  modeling.  There  is  a suggestion  that  TM 
could  be  modified  to  more  than  double  its  IFOV  by  increasing  the  number  of  de- 
tectors in  the  focal  plane  and  putting  on  more  scan  mirror  monitors  (to  better 
identify  the  scan  profile). 

Due  to  the  torques  involved  in  the  scanning  process,  especially  for  highly  ef- 
ficient scanning  techniques,  high-frequency  positioning  errors  (jitter)  can 
result  from  flexible  body  effects  in  the  instrument  as  well  as  in  the  platform 
to  which  it  is  attached.  Techniques  need  to  be  developed,  beyond  those  which 
exist  in  the  Landsat-D/TM,  for  budgeting  and  modeling  these  errors.  This  would 
include  the  possibility  of  having  to  measure  the  instrument  boresight  includ- 
ing effects  individual  optical  element  motions. 

In  addition,  techniques  need  to  be  developed  to  reduce  the  magnitude  of  the 
positioning  errors  through  the  use  of  actively  controlled  optical  elements  .-id 
the  isolation  of  instrument  dynamics  from  those  of  the  platform. 

c)  SAR;  Unlike  the  scanning  and  MLA  sensors,  a significant  amount  of  geomet- 
ric distortion  can  result  in  the  signal  processing  segment.  The  purpose  of 
such  segments  is  to  convert  from  a raw  image  into  a slant  range/azimuth  image. 

Processing  errors  include:  a)  estimation  of  FM  rate,  b)  azimuth  compression 
technique  (time  domain,  frequency  domain),  c)  range  cel]  migration  correction 
and  associated  interpolation,  d)  block  processing  techniques,  e)  doppler 
centered  tracking  accuracy,  and  f)  terrain  variation  effect  on  point  target 
locations. 

To  map  the  slant  range/azimuth  image  to  a certain  n.ap  projection,  remapping 
and  resampling  errors  are  introduced.  Remapping  does  not  require  attitude  in- 
formation. Remapping  errors  include:  a)  ephemeris,  b)  earth  curvature,  c) 
GCP  accuracy,  d)  terrain  variation,  and  e)  atmospheric  refraction  (very  severe 
for  VOIR). 

A focus  of  the  study  on  the  following  is  recommended:  a)  Study  various  signal 
processing  algorithms  on  the  raw  image  and  their  tradeoffs.  Develop  error 
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models.  Investigate  how  error  propagates  from  one  processing  stage  to  the 
another.  b)  Develop  remapplng/resampling  error  model.  c)  Develop  an  error 
model  for  using  DTM  for  rectification/registration.  In  SAR  imagery,  terrain 
distortion  is  more  severe  than  it  is  in  the  scanner  imagery,  d)  Study  the  ef- 
fect of  terrain  variation  on  processing  algorithms,  since  terrain  affects  the 
target  trajectory  in  the  raw  image.  e)  For  planetary  missions,  no  GCPs  will 
be  available.  Study  whether  automatic  focusing  on  strip-to-strip  registration 
can  be  used  to  replace  ephemeris  parameters.  Develop  an  error  model. 

3*  7.2. 4.2  Spacecraft/Shuttle 

Spacecraft  and  Shuttle  models  for  future  systems  should  include  advanced  sen- 
s >r  and  system  models  which  would  provide  increased  knowledge  of  spacecraft 
induced  error  sources  which  are  commensurate  with  increased  resolution  ex- 
pected from  advanced  sensors.  Spacecraft  subsystems  which  must  be  modeled  in- 
clude: a)  attitude  measurement  systems,  b)  attitude  control  systems,  c)  orbit 
determination  syt  ems,  d)  orbit  control  systems,  e)  sensor  alignment  measure- 
ment systems,  f)  time  and  frequency  standards. 

Examples  of  future  spacecraft  systems  which  must  be  modeled  are:  advanced 
star  trackers,  advanced  horizon  sensors,  fine  pointing  sun  sensors,  and  ultra- 
stable gyro  systems.  The  above  system  models  are  components  of  the  attitude 
measurements  and  control  systems. 

An  instrument  could  be  provided  which,  through  repeated  overlapping  images  of 
the  ground,  can  provide  the  data  to  allow  generation  of  attitude  history  with- 
out reference  to  maps  or  other  surveyed  ground  points.  This  will  be  of  par- 
ticular use  in  shuttle  or  aircraft  systems.  This  data,  in  turn,  allows  image 
line-by-line  data  to  be  positioned  properly  in  the  rectified  image.  This  will 
allow  modifications  of  the  error  budget  by  providing  images  with  greater  geo- 
metric accuracy. 

For  orbit  measurement  and  control  systems,  on-board  orbit  determination  using 
Global  Positioning  System  (GP3)  data  or  utilizing  Tracking  and  Data  Relay 
Satellite  System  (TDRSS^  data  must  be  modeled.  Accelerometer  packages  to  mea- 
sure nonconservative  accelerations  could  be  modeled  along  with  on-board  actu- 
ators for  orbit  control.  Ephemeris  data  resulting  from  precision  6^ound  based 
orbit  determination  must  also  be  modeled. 

Time  maintenance  and  time  transfer  systems  to  be  modeled  include  GPS  and  TDRSS 
time  transfer  and/or  flying  with  stable  oscillators. 

Studies  resulting  from  the  development  of  the  above  models  would  be  the  gener- 
ation of  error  budgets  for  varying  system  configuration  and  performing  end- 
to-end  trade-off  studies  such  as  cost  impacts  and  enabling  technology  impacts 
of  improving  spacecraft  system  knowledge  such  that  GCP  processing  can  be 
either  eliminated  or  substantially  reduced. 

3. 7.2.  *4. 3 Processing/ In  formation 

Often  in  the  design  and  development  of  processing  systems  there  are  not  strong 
and  specific  idsnti f ications  as  to  what  function  must  be  performed  to  insure 
that  the  end  product  is  most  oeneficial  to  the  user  needs.  The  functions  may 
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be  isolated  to  hardware  or  software  components  nut  mu  t include/reflect  algor- 
ithms that  eliminate/reduce  errors  from  the  data  source,  sensor/spacecraft. 

The  development  of  supporting  processing  system  should  begin  concurrent  with 
the  development  of  the  sensor/spacecraft  at  or  during  the  phr  v VB  studies. 
If  the  processing  system  was  designed  with  the  understanding  01  possible  error 
enhancement  to  this  data  source,  then  data  recovery,  correction,  and  error  re- 
moval procedures  should  be  considered  in  the  design. 

Some  factors  that  must  be  considered  in  this  processing  system  to  eliminate/ 
minimize  errors  are:  a)  ephcmeris  accuracy/variations,  b)  sensor  alignment, 
c)  data  translation,  d)  geometric  errors  and  systematic  correction  (orbit/ 
attitude),  e)  scanning  sensor’s  rates,  gaps,  and  profile,  f)  lessons  learned 
from  historical  sensors,  g)  image  corrlation/matching  techniques,  h)  temooral 
processiug/data  translation,  i)  pixel  errors,  j)  cartographic  and  mosaic  er- 
rors, k)  integration  of  multisensor  data,  1)  ground  control  point/pcinting 
tolerances,  m)  edge  detection/image  snarpness/filtering,  and  n)  image  warping. 

The  processing  system  should  also  give  the  users  some  information  about  whet 
corrections,  algorithms,  filters,  etc,,  were  used  in  correlating  the  proluct. 
This  data  will  facilitate  the  user  understanding  and  use  of  the  final  product. 

3. 7.2. 4.4  Study  Group 

It  is  recommended  that  a permanent  Ad  Hoc  Earth  Observing  System  Error  Araly- 
sis  Working  Group  be  established  at  the  NASA  Headquarters  level.  The  pur  se 
of  this  working  group  is  to  advise  the  NASA  Program  Manrger  on  technical  e- 
quirements  and  limitations  relating  to  error  characterization,  error  budgets, 
and  system  verification. 

Establishment  of  this  working  group  is  imperative  to  preserve  continuity  in 
the  Earth  Observing  Systems  Techniques  and  Data  Processing  Development  Prog- 
ram. The  working  group  members  should  be  comprised  of  system  designers  and 
system  users  and  be  representative  of  the  government,  industry*  and  university 
communities. 
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3.7.4  Appendices  to  Error  Characterization  and  Error  Budgets  Subpanel 


APPENDIX  A 

POSITIONING  REQUIREMENTS  COMPATIBLE  WITH 
NMAS  FOR  1:24,000  TOPOGRAPHIC  MAPS 


The  basic  assumption  in  this  exercise  is  to  set-up  a "straw-man11  mission  de- 
signed to  provide  data  suitable  for  meeting  National  Map  Accuracy  Standards 
NMAS  for  1:24,000  scale  topographic  and  planimetric  map  products.  This  is  a 
geometric  requirement  rather  than  a nonmetric  informational  requirement.  In 
addition,  the  change  is  to  produce  these  x,  y,  z earth  system  coordinate  data 
with  minimal  reference  to  ground  control.  The  geometric  requirements  will,  in 
turn,  define  the  IFOV  of  the  system.  As  will  be  noted,  an  IF0V  of  about  3-4  m 

will  be  required  to  meet  the  accuracy  standards.  The  following  statements  are 

not  meant  to  advocate  this  system,  but  rather  to  consider  its  feasibility  in 
terms  of  error  budgets  and  error  budget  modeling  methodology. 

I.  National  map  accuracy  standards  (NMAS)  for  1:24,000  scale  map  products 
require: 

a.  90%  of  horizontal  positions  (for  well  defined  points)  be  estab- 
lished to  +12  m cf  their  correct  location.  The  acceptable  RMSEy  y (68%) 
is  approximately  +7  rc. 

b.  90%  of  elevations  interpolated  from  contour  lines  will  be  correct 

to  within  1/2  the  contour  interval  (Cl).  The  acceptable  RMSE  will 
therefore  t equal  to  the  C.I./3.3.  As  most  1 :24,000  scale  maps  have 

C.I.  of  5,  u,  20,  or  40  feet  (depending  on  the  terrain),  the  RMSE  re- 

quirements are  approximately  +0.5,  1,  2,  and  4 m respectively . Because 
elevation  standards  are  the  most  stringent  requirement,  they  will  con- 
trol system  design. 

II.  System  Design  Assumptions 

a.  The  assumed  imaging  system  consists  of  three  line-array  cameras  op- 
e^'tl.ig  in  the  pushbroom  mode.  Two  of  the  cameras  will  be  oriented  ap- 
proximately 24  degrees  from  the  vertical  in  a convergent  arrangement  in 
order  to  provide  fore  and  aft  coverage  while  the  third  camera  is  aligned 
vertically  so  as  to  produce  near  orthographic  coverage  of  the  terrain. 
This  configuration  results  in  potential  Kase-height  (B/H)  ratios  of  1.0 
for  fore  and  aft  stereopairs  and  0.4g  when  the  vertical  is  employed  with 
either  fore  or  aft  coverage. 

b.  Altitude  - set  between  5 0 and  1000  km,  e.g.,  713  km  or  919  km 

c.  IFOV  £ 5 m:  to  be  det_.\n  r>*_d  by  NMAS,  geometric  and  correlation  re- 
quirements, rather  than  by  nonmetric  information  requirements 

d.  Swath  - TBD  in  the  range  60-185  km 

e.  The  feasibility  of  a mission  designed  to  most  of  the  above  NMAS  re- 
quirements remains  to  be  demonstrated. 
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Ill*  B*ror  Considerations  and  Sources 


a.  Maximum  RMSEs 

1.  Horizontal  (X,Y)  = ♦ 7 m 

2.  Vertical  (Z)  = + 3 m (for  10  m C.I.) 

b.  Error  Considerations 

1.  General 

The  mission  must  provide  essentially  error-free  geometric  and 
radiometric  data  if  accurate  map  products  are  to  be  developed. 
In  theory,  the  spacecraft  and  sensor  systems  can  be  controlled 
so  as  to  preclude  any  special  ground  based  computer  processing 
(to  correct  the  errors),  which  i3  both  expensive  and  subject  tc 
delay. 

The  parameters  which  influence  the  geometric  fidelity  of  the 
image  data  include  pointing  control  rate  motion  stability  and 
jitter.  The  satellite  line-array  sensor  system  (which  is  re- 
cording the  terrain  as  a series  of  cross-track  strips)  must  be 
pointed  correctly  and  held  stable  for  approximately  100  seconds 
to  produce  error- free  stereo  imagery.  Any  perturbation  of  the 
sensor  system  during  the  recording  period  will  cause  displace- 
ments/errors in  the  data  which,  in  turn,  may  require  geometric 
correction  and  resampling  at  a ground  receiving  station.  Rota- 
tion of  the  spacecraft  about  the  X,  Y,  and  Z axes  (**oll,  pitch, 
and  yaw,  respectively),  although  constrained,  will  cause  defor- 
mations of  the  nominal  image  format  as  will  changes  in  space- 
craft altitude  and  oblateness  of  the  Earth. 

2.  Earth  Rotation 

The  ba3ic  imaging  concept  is  straightforward,  however,  because 
of  Earth  rotation,  the  satellite  ground  track  is  no  longer  a 
simple  great-circle  route,  and  the  vertical,  fore,  and  aft  cam- 
eras will  not  automatically  image  the  same  ground  area,  even 
with  a perfectly  stabie  satellite.  In  order  to  obtain  ground 
coverage  common  to  any  two  cameras,  a yaw  motion  must  be  intro- 
duced into  the  earner Vspaeecraft . This  motion  is  not  constant, 
but  must  vary  with  latitude  to  maintain  image  registration. 

3.  Oblate  Earth 

The  basic  imaging  concept  assumes  a spherical  Earth  and  a cir- 
cular satei'ite  orbit  so  that  a constant  satellite  altitude  is 
maintained.  In  practice,  however,  we  must  consider  an  oblate 
spheroid  and  an  orbit  which  only  approximates  to  a circle  due 
to  variations  in  the  gravitational  effect  of  the  Earth.  These 
deviations  from  the  ideal  situation  create  increases  in  slant 
range  and  altitude  which  in  turn  cause  socle  variations  as  the 
satellite  increases  its  distance  from  the  equator. 
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Resampling  Considerations 


Any  image  deformations  which  are  not  maintained  within  speci- 
fied limits  must  be  removed  in  the  ground  data  p-ocessing.  The 
pixels  may  be  resized,  reshaped,  realigned,  and  new  grey  level 
values  determined  to  provide  the  necessary  image  quality.  An 
objective  of  the  mission  is  to  acquire  error-free  data  which 
will  eliminate  the  need  for  resampling  (and  minimize  geometric 
corrections) . 

5.  Spacecraft  Performance 

In  order  to  reach  some  conclusions  regarding  the  geometric  ac- 
curacy, it  is  necessary  to  consider  the  pointing,  stability, 
and  jitter  of  the  spacecraft  and  its  sensors.  Pointing  accur- 
acv  is  the  factor  most  often  quoted  as  a measure  of  geometric 
performance.  For  example,  the  Multimission  Modular  Spacecraft 
(MMS)  which  will  be  employed  for  Landsat-D  has  a pointing  ac- 
curacy specification  of  +0.01  degree  (one  sigma)  . Thus,  by  de- 
sign, the  summation  of  all  factors  that  include  the  attitude 
control  subsystem  should  have  a root-near-square  value  of  less 
than  the  design  specification.  In  addition,  other  factors  such 
as  orbit  determination,  timing,  sensor  alignment  with  the  atti- 
tude control  system  (including  the  effects  of  thermal  instabil- 
ities), and  the  torquing  motions  of  a tape  recorder  (if  used) 
influence  the  pointing  geometry.  Satellite  stability  is  an  im- 
portant consideration.  Extremely  tight  tolerance  will  be  re- 
quired te.g.,  10 deg/sec  at  the  3T  level  cr  better). 

The  third  problem  is  jitter.  The  satellite  will  respond  to 
dynamic  disturbances  caused  by  antenna  or  sol  nr  panel  motions 
as  would  a tuning  fork.  Response  is  frequency  dependent  be- 
cause of  structural  qualities.  No  moving  parts  are  desired. 

Error  Sources  Influencing  the  Mapping  Potential 

From  a cartographic  viewpoint,  the  most  significant  problems  are  likely 
to  be  of  a geometric  nature.  Consequently,  it  is  desirable  to  determine 
the  accuracy  to  which  X,  V,  7 terrain  coerdi antes  can  be  recovered  from 
image  data  recorded  by  the  proposed  line-array  system. 

Major  factors  which  appear  to  determine  the  accuracy  to  which  X,  Y,  and 
Z terrain  coordi antes  can  be  recovered  are  listed  below:  An  attempt  is 

made  to  estimate  quantitatively  the  magnitudes  of  the  starred  error 
sources  in  terms  of  root-mean-square  error  (RMSE). 

1.  Position  of  S'C  Error  Sources 

2.  Pointing  of  sensors  and  attitude  control 

3-  Satellite  velocity 

Um  Precision  of  measurement 

5.  Reliability  of  ground  control 

6.  Earth  curvature,  atmospheric  refraction,  etc. 

7.  Processing  equipment  and  procedures 

8-  Adjustment  Procedures 


a)  Position  of  S/C 

The  positional  determination  of  the  S/C  must  be  within  10  u for  all 
three  axes. 

b)  Sensor  Pointing  and  Attitude  Control 

Nominal  correction  values  for  a constant  bias  car*  be  determined 
with  the  aid  of  ground  control.  In  many  areas  of  the  world,  how- 
ever, ground  control  is  inadequate  for  mapping  tasks,  and  alterna- 
tive methods  of  establishing  corrections  for  pointing  errors  must 
be  made  available. 

Attitude  stability  and  maintenance  of  controlled  yaw  are  critical 
parameters.  In  order  to  achieve  acceptable  coordinate  values  with 
reasonable  consistency,  a worst-case  correction  rate  value  of 
deg/sec  at  the  3~?igma  level  of  confidence  is  required.  This 
equates  to  +4  m (approximately  1 pixel)  over  the  10-minute  time  in- 
terval and  should  provide  an  epipolar  condition. 

The  overall  requirement  for  pointing  determination  accuracy  is  bet- 
ter than  one  arc  sec  (-4  m from  800  km).  This  will  be  a major 
source  of  error. 

c)  Satellite  Velocity 

Variation  in  satellite  velocity  can  be  accounted  for  if  accurate 
timing  marks  can  be  incorporated  in  the  data.  GPS  is  a source  for 
time  data. 

d)  Measurement  Error 

Measurement  or  correlation  error  must  be  limited  to  well  within 
one-half  the  RMSE^  „ value  in  order  to  meet  ve-  tical  accuracy  re- 
quirements. Thus.’RMSEs  in  horizontal  measurer  must  be  on  the 
order  of  1-2  m. 

e)  Reliability  of  Ground  Control 

It  is  anticipated  that  a minimum  number  of  ground  control  points 
will  required.  However,  they  will  have  to  be  accurate  to  1-2  m. 
Possibilities  for  autotriangulation  exist,  but  error  figures  cannot 
be  determined  at  this  time. 

f)  Earth  Curvature  and  Refraction 

Errors  due  to  Earth  curvature  and  refraction  are  systematic  and  can 
be  corrected  during  processing.  The  influence  of  variations  in  re- 
fraction is  negligible  for  a narrow  (5°)  field-of-view. 

There  are  other  error  sources  which  will  need  to  be  considered. 
However,  the  magnitude  of  the  aw  *e  errors  in  relation  to  NMAS  can 
be  estimated. 
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3.8  REPORT  OF  THE  SUBPANEL  ON  METHODS  OF  VERIFICATION* 


The  methods  of  verification  subpanel  met  for  two  4-hour  sessions  on  November 
18  and  19*  1981,  to  define  research  needs  ir  this  area  for  Earth  resource  ob- 
servational systems.  The  panel  consisted  of: 


John  C.  Lyon 
GSFC 

Maria  Kalcic 
NASA/NSTL 

B.R.  Seyfarth 
NASA/NSTL 

Johh  S os 
NASA/GSFC 

Gerald  Grebowsky 
NASA/GSFC 


John  Snyde 
USGS 

Ai  Chun  Fang 
NASA  Headquarters 

R.B.  MacDonald 
NASA/ JSC 

William  P.  Clark 
NASA/GSFC 

Len  Gaydos 
USGS 


3.8.1  State  of  Knowledge 

We  refer  to  verification  as  a production  oriented  question  because  we  are  not 
really  doing  verification  for  the  uses  of  research  activities.  We'r^  trying 
to  verify  output  data  products  from  a production  system  for  production  ori- 
ented users.  Included  in  that  class  of  production  oriented  users  is  the  pro- 
duction system  itself,  i.e.,  quality  control  of  output.  Verification  is  not  a 
well  defined  problem.  We're  just  beginning  to  focus  on  understanding  what 
we're  talking  about.  Therefore  we  recommend  a program  tc  improve  the  state  of 
understanding  and  of  the  meaning  of  verification  and  the  application  of  veri- 
fication procedures  to  a variety  of  sensor  systems. 

3.8.2  Recommended  Research 

Tne  topics  of  interest  that  were  identified  are  very  strongly  interrelated. 
To  show  this  we  have  developed  a task  flow  in  Figures  1,  2,  and  3*  Other  than 
having  done  that,  it  war  found  that  there  is  no  real  priority  scheme  that 
could  be  assigned,  as  this  is  an  integrated  activity  designed  to  provide  more 
understanding  into  what  needs  to  be  done  in  imag~  rectification.  Task  one 
(Figure  1)  is  to  develop  verification  procedures.  Task  two  (Figure  2)  in- 
volves an  experimental  hands-on  data  demonstration  and  evaluation  of  those 
procedures  in  a controlled  test-bed  experiment.  For  task  one,  the  flow  is  as 
follows:  you  first  need  to  identify  what  performance  measures  you're  really 
concerned  about.  We've  suggested  a handful  of  starters  such  as  the  number  of 
control  points,  residual  correlation  mapped  across  an  image,  and  the  distribu- 
tion of  errors  within  the  image  plane  for  individual  and  coincident  sets  of 
images.  Using  that  information,  it  is  possible  to  gc  directly  to  existing 
data  and  compile  real  and  synthetic  data  sets  that  can  address  that  problem. 
In  parallel,  one  can  review  the  current  verification  procedures  that  are  used. 


•Edited  oral  presentation. 
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This  is  not  a trivial  undertaking  in  spite  of  the  fact  that  the  current  veri- 
fication procedures  are  very  casual  and  unsystematic.  There  are  some 
activties  going  on  in  other  fields,  in  mapping  especially,  that  have  orderly 
procedures  that  are  not  exactly  remote  sensing  oriented  procedures  but  can  be 
training  grounds  for  a subsecr^nL  task.  From  the  existing  procedures,  identi- 
fy and  recommend  the  ones  on  hand  that  are  usable  in  an  operational  system, 
develop  additional  techniques  necessary  with  some  synthetic  uata  sets,  and 
perform  specific  tests  on  individual  package  procedures  to  analyse  the 
results.  The  end  result  then  is  a set  of  verfication  procedures  and  software, 
or  at  least  algorithms,  that  can  be  useable.  The  output  of  that  then  goes  to 
task  two,  which  is  the  verification  experiment. 

Task  two  is  the  end-to-end  test  experiment.  ^e  very  first  step  in  task  two 
is  to  identify  the  test  bed.  There  are  several  possible  options  and  it’s  a 
matter  of  timing  and  some  other  subtle  details  that  relate  to  exactly  what 
procedures  and  requirements  you  want  to  develop.  The  output  of  the  first  part 
of  task  one  delineates  what  verification  you  really  want  to  do  that  will  help 
to  choose  a test-bed.  The  obvious  choices  on-hand  are  Landsat  MSS  data  or,  in 
the  near  future,  the  Landsat-D  data  processing  capabilities.  The  next  step  is 
to  design  the  experiment  to  test  verification  procedures.  This  procedure  in 
development  and  selection  activity  is  from  task  one,  as  it  is  essentially  task 
one  that  feeds  into  that  knowledge  of  the  sensor  system  itself,  including  er- 
ror budgets,  as  a part  of  establishing  the  design.  Then  it's  a natter  of  im- 
plementing the  experiment.  The  output  of  doing  software  oriented  measurements 
on  st; 'idardized  data  sets  allows  one  to  perform  some  accuracy  measurements. 
You  want  to  pay  very  close  attention  to  the  feedback  loop  so  that  when  you  get 
part  way  there  you  start  looKing  at  the  users  on  the  other  side  of  the  infor- 
mation system  that  need  to  see  the  results  to  help  better  understand  what  they 
really  wanted  to  have  asked  you  for  in  verification . That  finally  leads  you 
to  moving  one  step  beyond  to  the  internal  problem  and  you  start  deriving  the 
error  sources  observed  and  finally  report  and  assess  the  results  of  this 
experiment. 

Tables  I and  II  outline  in  summary  form  the  required  elements  for  each  task 
described . 


bl 


TASK  1 

DEVELOP  VERIFICATION  PROCEDURES 
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ANALYZE  DERIVED  VERIFICATION  REQUIREMENTS  VS  CURRENT  APPROACHES 
IDENTIFY  VERIFICATION  APPROACHES 


DEVELOP  ADDITIONAL  TECHNIQUES 


OF  POOR  QUALiH 
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IMAGE  VERIFICATION  END-TO-END  TEST 
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0 USER  CHECK  OF- ACCURACY  REPORT 

0 SENSOR  SYSTEM  DEVELOPER  OPINION  OF  RECOMMENDED  CHANGES 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Veri fication 
Procedures 
and  Software 


To  Verification 
Experiment 


FIGURE  1.  TASK  ONE:  ACTIVITY  FLOW 
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ORIGiNAL  PAGE  :S 
OF  POOR  QUALITY 


NECESSARY 


CLOSED  LOOPS 

MANDATORY 

BETWEEN 

VERIFICATION  & USERS 
VERIFICATION  AND 
INSTRUMENT  AND 
PRODUCTION  FACILITY 
PROCESS  IS  ITERATIVE 
REFINEMENT  OF  DATA 
SETS  ON  QUANTIFIED 
MEASUREMENT 


FIGURE  2. 


IMAGE  VERL  ICATION  END-TO-END  TESTING 
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PRESENTATIONS  ON  USER  NEEDS 


Y 


/ 


4.0 

4.1  INTRODUCTION 

It  was  the  purpose  of  the  User  Needs  presentations  to  discuss  the  implication., 
of  satellite  image  pcsitional  accuracy  capabilities  upon  their  discipline's 
use  of  the  data.  Discipline  experts  discussed  the  manner  in  which  data  are 
incorporated  into  their  inventory,  decision,  or  analysis  models  and  opera- 
tions. For  each  discipline  area,  monitoring  and  data  base  integration  stra- 
tegics were  discussed;  in  particular,  implications  for  registration  and  recti- 
fication requirements.  In  addition,  the  discussants  pointed  out  the  potential 
benefit  that  might  accrue  from  improved  registration/rectification  accuracy. 
Where  appe  cable,  the  discipline  experts  discussed  their  desire  to  implement 
multitemporal , multistage,  and  multisensor  data  source?  for  addressing  a prob- 
lem, as  these  imply  constraints  on  registration  and  rectification  accuracies. 
Users  also  described  the  experimental  design  (e.g.,  *-mple  segments  or  full- 
image  area  coverage)  used  to  analyze  a problem. 
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4.2  USD  A REGISTRATION  AND  RECTIFICATION  REQUIREMENTS 

Rich  Allen 

Statistical  Reporting  Service 
U.S.  Department  of  Agriculture 

I am  glad  to  have  this  opportunity  to  discuss  some  of  the  requirements  of  the  United 
States  Department  of  Agriculture  (USDA)  for  accuracy  of  aerospace  acquired  data,  and 
specifically,  requirements  for  registration  and  rectification  of  remotely-sensed  data 
acquired  by  space  vehicles,  such  as  Landsat,  the  Shuttle,  and  so  on.  The  views  presented 
are  for  the  most  part  my  observations  and  opinions  from  work  completed  to  date  or 
underway  in  the  Dep?rtment  of  Agriculture  since  only  limited  documentation  exists  on  the 
accuracy  required  for  , egistration  and  rectification  as  such. 

Definition  of  Terms 


It  is  perhaps  wise  to  first  explain  the  terms  to  be  used  in  the  presentation.  One  of  the 
organizers  of  this  conference  indicated  that  registration  refers  to  the  accui  acy  of  location 
of  identical  points  on  repeated  acquisitions  of  data  while  rectification  refers  to  accuracy  of 
matching  remotely-sensed  data  with  corresponding  points  on  the  ground.  Many  people  in  the 
USDA  use  the  expression  "registration"  for  matching  both  scene-to-scene  and  scene-to-map 
and  use  the  tern  "rectification"  for  indicating  accuracy  of  maps  or  aerial  photographs.  I 
will  try  to  utilize  the  announced  definitions  of  this  conference,  although  I may  often  use  the 
broader  term  of  positional  accuracy  to  refer  to  the  USDA  requirements. 

Remotely-Sensed  Data;  An  Important  Source  of  Information 

In  order  to  carry  out  its  assigned  missions,  the  Department  of  Agriculture  must  have 
information  relating  to  observations  of  soils,  crops,  and  other  physical  features.  For 
example,  we  identify  and  map  sc  il  types,  monitor  conservation  practices  and  conservation 
structures  (construction  of  new  conservation  measures),  and  verify  farmers'  compliance  with 
planting  restrictions  under  various  farm  programs.  All  of  these  types  of  information 
programs  have  intense,  detailed  data  needs.  Aerial  photography  has  been  utilized  to  provide 
much  oi  the  needed  data  for  these  programs.  An  aerospace  sensor  is  not  now  foreseen  as 
being  capable  of  providing  comparable  data  required  in  such  domestic  programs.  I 
emphasize  the  term  "domestic".  However,  we  can  characterize  the  positional  accuracy 
needs  of  these  information  programs,  and,  in  so  doing,  may  provide  general  guidance  for 
aerospace  sensor  development  programs. 

If  an  aerospace  sensor  could  be  developed,  budgets  permitting,  to  satisfy  some  of  the 
needs  above,  t •*  sensor  would  ha  ye  to  have  spatial  resolution  similar  to  that  of  aerial 
photography  to  be  judged  useful  to  USDA  or,  better  put,  to  be  competitive  with  aerial 
photography.  By  the  same  analogy,  the  USDA  would  need  the  same  rectification  as  with 
aerial  photography  to  utilize  that  spatial  resolution. 

Satellite  Data  Uniquely  Suited  for  Specific  Programs 

However,  in  this  paper  I want  to  concentrate  on  four  other  types  of  information 
programs,  ones  for  which  satellite  data  are  being  routinely  used  or  at  least  currently 
investigated  for  possible  use  later.  In  these,  because  of  the  unique  features  of  the 
requirements,  satellite  data  are  "competitive"  with  other  information  sources.  These  four 
information  programs  are: 

Foreign  crop  forecasting 
Domestic  crcp  acreage  estimation 
Forestry  information  applications 
Rangeland  condition  evaluations 
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I believe  there  are  similarities  and  contrasts  among  these  four  programs  which  will  illustrate 
the  range  of  USDA  requirements  for  positional  accuracy.  These  examples  are  not  considered 
an  exhaustive  list  of  USDA's  present  interests  for  satellite  data. 

Landsat  and  Metsat  Data  Used  for  Foreign  Crop  Condition  Assessment 

The  foreign  crop  assessment  approach  that  1 wish  to  discuss  is  that  of  the  Foreign 
Agriculture  Service's  Foreign  Commodity  Condition  Assessment  Division  (FCCAD).  FCCAD 
is  processing  large  numbers  of  satellite  scenes  from  bnth  Landsat  and  meterological  satellites 
in  its  current  efforts  to  mom  .or  areal  extent  of  anomolies  and  production  of  major  crops  in 
selected  foreign  areas.  For  rhe  most  part,  FvXAD  does  not  have  access  to  ground  collected 
data.  Thus,  it  depends  on  seriential  reviews  of  satellite  data  as  a procedure  for  monitoring 
and  evaluating  change. 

Presently  FCCAD  does  not  perform  any  registration  on  the  data  received  from  Landsat 
in  the  form  of  High  Density  Computer  Compatible  Tapes.  Each  scene  is  reduced  to  subsets 
or  samples  of  full  resolution  data  by  subsampling  rows  and  pixels  to  obtain  a data  set  better 
suited  to  FCCAD's  processing  capabilities.  This  reduced  data  set  can  then  be  displayed  on 
image  processing  equipment  as  raw  data  or  by  transforma  ion  to  vegetative  indexes,  which 
measure  the  "greenness"  of  plants,  and  are  indicators  of  plant  vigor  and  stress.  The 
Vegetative  Index  approach  is  an  effort  to  standardize  responses  and  allow  meaningful 
comparisons  within  seasons  and  across  seasons. 

Much  of  the  present  analysis  of  FCCAD  involves  calculation  of  average  values  for  a 
25-mile  square  grid.  Without  registration  procedures  there  may  be  some  shifting  of  points 
included  in  a particular  grid  celi  from  acquisition  to  acquisition  but  the  shifting  should  be 
minor  compared  to  the  size  of  the  grid  cells. 

The  approach  of  not  performing  any  additional  registration  of  satellite  acquired  data  is 
not  an  optimum  one  in  FCCAD's  point  of  view  but,  in  light  of  equipment  and  personnel  resources 
and  the  volume  of  data  being  handled,  it  is  not  feasible  to  devote  time  to  registration 
activities  at  this  time.  If  each  satellite  scene  obtained  had  consistently  "high"  positional 
accuracy  to  the  ground  and  thus  to  corresponding  scenes  of  other  data,  FCCAD  would  be 
interested  in  a major  refinement  of  its  multitemporal  analysis  procedure.  A much  better 
measure  of  changes  in  conditions  or  crop  area  could  be  obtained  if  the  data  for  specific 
sampling  segments  could  be  matched  throughout  a season  and  across  seasons.  Based  on  the 
spatial  resolution  of  the  current  Landsat  Multispectrai  Scanner  (MSS)  this  might  mean  use  of 
a segment  of  approximately  15-20  square  miles  in  size  All  data,  mcluding  vegetative  indices 
or  other  transformations,  would  be  calculated  and  stored  for  these  segments. 

Based  on  the  size  of  the  segment  visualized  it  would  be  reasonable  to  employ  this  sampling 
approach  if  satelli  e data  wete  rectified  or  registered  to  a mean  accuracy  of  plus  or  minus 
one  pixel.  This  error  in  location  from  acquisition  to  acquisition  would  be  small  enough 
compared  to  the  size  ol  the  segment  to  be  effective. 

If  a sensor  with  finer  spatial  resolution  was  available,  the  FCCAD's  accuracy  requirement 
would  likely  remain  at  one  pixel.  Its  approach  might  become  one  of  utilizing  somewhat 
smaller  segment  sizes  but  with  data  registered  within  one  pixel  to  maintain  the  same  relative 
accuracy. 

Use  of  Landsat  Data  for  domestic  Crop  Acreage  Assessment 

Research  into  tb*»  "se  of  Landsat  MSS  data  by  the  Statistical  Reporting  Service  (SRS) 
for  the  improvement  ..reage  estimates  of  major  domestic  crops  provides  a marked  contrast 
to  the  procedures  for  toreign  areas.  Unlike  the  ^oreign  Agricultural  Service  which  often  has 
no  ground  data,  SRS  has  available  a sample  of  ground  observation  data  which  by  itself  provides 
an  accurate  estimate  of  acreage. 

One  ol  the  major  inputs  to  crop  acreage  estimates  in  the  United  States  is  the  dune 
Enumerative  Survey  (JES)  conducted  each  year  by  SRS  in  the  48  coterminous  states.  The  3ES 
is  a probability  area  frame  survey  in  which  each  state  has  been  divided  into  land  use  strata 
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based  on  percentage  of  cultivation  and  type  of  !and  use.  Each  stratum  is  divided  into 
sampling  units,  with  size  depending  on  the  stratum.  In  the  Midwest,  intensive  agricultural 
sampling  units  or  segments  are  typically  one  square  mile  in  size.  Segment  sizes  in  rangeland 
strata  are  much  larger  and  sizes  in  residential  or  commercial  strata  are  much  smaller. 

The  JES  survey  provides  estimates  of  major  crop  acreages  with  coefficients  of 
variation  ranging  from  2.5  percent  to  6.0  percent  in  major  states.  At  the  U.S.  level  these 
coefficients  of  variation  are  as  small  as  1.0  - 2.0  percent. 

Thus,  the  SRS  research  effort  is  an  attempt  to  improve  the  precision  for  relatively 
"good"  acreage  estimates.  This  is  in  direct  contrast  to  the  foreign  crop  forecasting 
problem.  Therefore,  the  demands  for  positional  accuracy  are  much  higher. 

SRS  uses  the  3ES  data  for  training  of  classification  algorithms,  for  testing  of 
classification  results,  and  for  estimation  of  acreage  through  a regression  estimator.  The  JES 
data  is  closely  edited  on  a field-by-field  basis.  Random  fields  of  each  cover  of  interest  are 
selected  for  training.  The  SRS  approach  extracts  interior  pixels  of  training  fields  for 
labelling  so  it  is  important  to  ensure  accuracy  of  field  locations.  The  training  fields  for  a 
scene  are  selected  from  3E5  segments  located  throughout  the  scene.  Typically,  about  30 
segments  are  available  in  a Landsat  scene. 

Once  an  analyst  is  satisfied  with  the  clustering  relationships  for  a scene,  each 
segment  in  the  scene  and  the  entire  scene  (within  boundaries  of  geographic  counties  and 
excluding  cloud  covered  areas)  is  classified.  The  classification  of  segments  provides  the 
correlation  results  and  regression  parameters.  The  classification  o.  the  entire  scene 
provides  an  adjustment  for  any  differences  in  crop  acreage  relationship  between  the 
sample  of  segments  and  the  entire  population  of  possible  segments  within  the  scene. 

The  measure  of  effectiveness  of  using  the  satellite  data  which  is  most  meaningful  to 
SRS  is  relative  efficiency.  Relative  efficiency  is  defined  as  the  variance  of  the  direct 
expansion  (ground)  estimate  divided  by  the  variance  of  the  regression  estimator.  This 
number  indicates  what  amount  of  additional  ground  data  would  be  needed  to  give  an 
estimate  with  the  same  precision  as  the  regression  estimator.  Relative  efficiencies  in 
practice  have  ranged  from  2.0  to  4.0  or  higher  in  most  situations. 

The  research  approach  that  SRS  uses  for  full  state  estimates  (having  a revised  acreage 
estimate  by  the  end  of  the  estimation  season)  was  first  utilized  in  1978  for  the  State  of  Iowa 
and  has  been  utilized  in  1980  for  Iowa  and  Kansas  and  in  1981  for  those  two  States  plus 
Missouri  and  Oklahoma.  Based  on  those  experiences  and  other  esearch  SRS  is  projecting  an 
approach  of  utilizing  unitemporal  satellite  data  for  estimates  rather  than  a multitemporal 
approach.  While  multitemporai  data  have  been  used  «nd  would  give  better  discrimination 
for  some  classification  problems,  it  is  rare  to  obtain  cioud  free  images  during  the  growing 
season  in  the  Midwest  or  the  Great  Plains.  Some  counties  in  a scene  are  usually  lost  due  to 
clouds  in  the  growing  season  acquisition  date  and  if  other  counties  are  lost  in  a spring  scene, 
the  resultant  multitemporal  data  set  might  not  have  enough  segments  remaining  for  proper 
training  and  estimation.  SRS  does  have  multitemporal  procedures  on  line  and  will  use  them 
for  land  cover  estimates  and  for  crop  research  in  areas  such  as  California. 

Two  Stages  of  Registration  Insure  Positional  Accuracy  of  Landsat  MSS  Data 

Since  the  SRS  approach  depends  on  the  use  of  very  specific  data  sets  of  fields  for 
training  it  is  : nportant  to  match  as  exactly  as  possible  the  satellite  and  ground  locations. 
Presently  SRS  uses  two  stages  of  "registration"  to  insure  adequate  positional  accuracy  of 
Landsat  MSS  data.  The  first  effort  is  called  "global  registration".  A sample  of  points  is 
selected  across  the  scene  from  transparency  data  products.  The  corresponding  points  on 
U.S.  Geological  Survey  base  maps  are  located  and  digitized.  A mathematical  transformation 
is  calculated  to  adjust  all  pixels  to  predicted  longitude/ latitude  locations.  'riu„  process 
usually  ends  up  with  rectification  within  1 I to  2 pixels  across  the  scene.  This  operation  is 
now  performed  by  the  Remote  Sensing  Branch  Support  Staff  and  most  scenes  can  be 
"registered1-  in  about  3 hours,  even  with  editing  cl  outlier  points. 
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The  second  stage  of  "registration"  is  called  "local  segment  shifting"  by  SRS.  This  step 
is  necessary  because  of  scanner  anomalies.  A gray  scale  of  a window  enclosing  the 
predicted  segment  is  created.  An  overlay  of  the  digitized  segment  and  field  boundaries 
(printed  on  transparent  paper  at  satellite  data  scale  and  with  boundaries  adjusted  for  the 
path  of  the  satellite)  is  then  placed  over  the  gray  scale.  The  overlay  is  shifted  as  needed  to 
properly  line  up  segment  and  field  boundaries.  This  row  and  column  shift  from  predicted 
location  is  then  utilized  to  correctly  identify  the  most  accurate  location  of  each  field  in  the 
segment. 

This  segment  shif  ting  processing  results  in  rectification  of  data  to  the  nearest  one  half 
pixel  for  each  segment.  No  adjustment  is  made  in  the  remainder  of  the  scene  from  the  first 
stage  of  rectification.  Experience  has  shown  that  the  segment  shifting  adjustments  will 
normally  vary  across  the  scene  in  direction  and  size  of  shifts  so  the  segment  shifting  results 
are  not  imposed  on  the  global  rectification  stage.  This  indicates  that  although  SRS  needs  Yi 
pixel  accuracy  for  small  scale  classification  of  segments  the  accuracy  of  1 pixel  or  so  across 
the  rest  of  the  scene  io  sufficient.  There  are  large  numbers  of  pixels  associated  with  each 
stratum  within  a scene  and  the  1 pixel  potential  error  is  not  a critical  percentage.  SRS 
would  replace  either  or  both  of  these  "registration"  procedures  if  data  received  always  were 
rectified  to  the  appropriate  accuracy. 

The  "4Q  meter  Accuracy  Requirement"  Better  Stated  as  :,One-Half  Pixel" 

This  might  be  the  best  point  to  discuss  the  USDA's  "40  meter  accuracy  requirement". 

In  the  Domestic  Crops  and  Land  Cover  project  of  the  AgRISTARS  research  program  SRS  has 
specified  40  meters  as  the  desired  precision  for  both  scene-to-scene  and  scene-to-map 
applications  which  utilize  LANDSAT  MSS  data.  Some  members  of  the  remote  sensing 
community  have  interpreted  this  to  be  an  absolute  (ground  distance)  requirement.  The  40 
meters  originated  because  the  resolution  of  the  MSS  data  as  acquired  was  assumed  to  be  80 
meters.  Accuracy  to  a half  pixel  would  be  40  meters.  Regardless  of  effective  pixel  size  due 
to  processing  techniques  the  40  meters  was  regarded  as  the  feasible  positional  accuracy  for 
Landsat  MSS.  The  40  meters  is  not  the  important  measure;  the  half  pixel  is  the  key. 

SRS  regards  one  half  pixel  to  be  the  accura  :y  goal  for  any  advanced  resolution  sensor. 
This  is  due  to  the  emphasis  on  providing  the  most  accurate  data  set  for  training  on  a field  to 
field  basis.  A sensor  with  improved  resolution  such  as  the  thematic  mapper  should  result  in 
improved  classification  results  but  only  if  a pure  training  and  testing  set  can  be  insured. 

Rectification  and  Registration  in  Forestry  Applications 

The  U.S.  Forest  Service  (USFS)  has  utilized  aerial  photography  as  a tool  in  providing  a 
number  oi  inventory  ana  management  needs.  The  USFS  approach  is  similar  to  that  ol  SRS  in 
that  ground  observation  data  is  or  can  be  available.  The  USFS  objectives  are  more 
demanding  than  those  of  SRS  because  a variety  of  types  of  information  are  desired.  Instead 
of  just  estimating  area  of  forest  land  there  is  a need  for  determination  of  forest  types, 
measures  of  change,  and  some  detailed  estimates  such  as  the  annual  increment  of 
production.  USFS  is  often  interested  in  production  estimates  for  land  with  considerable  slope 
and  varied  terrain  in  contrast  to  the  relatively  level  terrain  for  crop  acreage  estimates. 

The  USFS  has  a major  research  effort  referred  to  as  the  Multiresource  Inventory 
Methods  Pilot  Test  (MIMPT)  which  is  an  advanced  demonstration  of  the  use  of  Landsat 
satellite  technology  to  supplement  current  methods  of  conducting  recurrent  inventories 
over  large  land  areas.  The  base  program  has  established  a laige  sample  of  sites  which  can 
be  periodically  monitored  for  change  and  new  resource  assessment  data.  Much  of  the 
necessary  data  can  be  obtained  from  aerial  photography  and  thouiands  of  aerial  photos  are 
utilized  when  new  photography  acquisitions  become  available.  The  basic  reference  link  is 
provided  by  7-1/2  minute  USUS  quadrangle  maps. 
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Results  from  the  first  phases  of  the  MIMPT  indicated  that  computer  interpreted 
Landsat  data  combined  with  data  from  a relatively  few  aerial  photos  can  replace  human 
interpretation  of  thousands  of  photos  to  estimate  land  use  acreages.  When  the  Landsat  data 
are  included  in  a geographic  information  system  with  other  data  sources  such  as  topographic 
and  soils  data,  it  is  possible  to  derive  variables  needed  in  multiresource  surveys  such  as 
sedimentation,  disturbances  and  other  spatial  dependencies  such  as  public  use,  utilities,  or 
transportation  infrastructures. 

Because  of  the  combination  of  Landsat  data  with  other  data  in  a geographic 
information  system  and  the  necessity  to  extract  specific  features  from  ground  sites  for 
training  and  evaluation,  very  precise  rectification  of  imagery  is  needed.  The  desired 
accuracy  of  the  USFS  would  be  rectification  of  95  percent  of  all  pixels  within  ground  sites 
to  within  + 20  meters  cf  true  ground  location.  This  very  precise  goal  is  because  of  the 
irregular  Thape  of  many  features  being  observed  and  of  other  variables  such  as  topographic 
information.  In  this  specific  application,  the  agency  requirement  is  stated  in  terms  of  a 
physical  measurement  irrespective  of  pixel  size,  in  contrast  to  FAS  and  SR5  requirements. 

Rangeland  Applications:  One  Pixel  Accuracy  May  be  Sufficient 

The  last  aerospace  remote  sensing  application  of  the  USDA  that  I would  like  to  discuss 
is  that  of  assessing  rangeland  condition.  I will  not  attempt  to  discuss  any  programs  of  the 
Bureau  of  Land  Management  related  to  rangeland  carrying  capacity  or  other  measures. 
Instead  I want  to  focus  on  research  interests  of  USDA,  notably  of  the  Soil  Conservation 
Service  (SCS).  Although  some  initial  work  has  been  done,  research  is  basically  just  getting 
underway,  and  conclusions  on  accuracy  are  tentative  at  best. 

SCS  is  interested  in  such  factors  as  conservation  needs  ol  rangeland  as  well  as  ra:«ge 
condition  and  biomass  production.  There  is  a great  need  for  additional  research  into 
methods  for  using  satellite  data  in  proper  estimation  of  range  condition.  Rangeland 
typically  is  quite  variable  across  an  area  of  any  size.  That  is,  there  is  not  usually  the 
homogeneity  that  would  be  expected  in  a field  of  a planted  crop.  Sampling  procedures  tend 
to  obtain  kinds  and  amounts  of  biomass  for  relatively  small  areas,  often  for  points  selected 
by  the  range  conservationist  on  the  grcunc  which  are  "representative"  of  conditions 
observed. 

One  approach  which  might  be  helpful  ».i  the  evaluation  of  range  condition  would  be  .o 
utilize  an  image  as  a stratification  device  and  to  collect  biomass  data  for  each  stratum 
present  in  the  image.  However,  while  range  condition  changes  with  longer  term  use  or 
abuse,  range  biomass  changes  quickly  with  rapid  response  to  rainfall  and  drought.  By  the 
time  an  image  is  available,  interpreted,  and  in  the  hands  of  a person  on  the  ground,  the 
conditions  may  have  changed  drastically.  Thus,  some  type  of  sampling  approach  is  needed 
which  collects  data  at  cr  near  the  time  of  satellite  data  acquisition  to  be  related  by  cluster 
analysis  or  some  other  type  of  estimation  based  on  the  satellite  data. 

One  approach  which  might  be  applicable  to  the  SCS  information  needs  is  to  collect 
data  over  some  type  of  grid  pattern.  Collection  of  data  for  enough  grid  points  and 
collection  of  biomass  (or  other  information)  for  a large  enough  unit  at  each  point  to 
minimize  within  sampling  unit  variation  would  allow  estimation  through  a poststratification 
approach  with  the  strata  based  on  the  satellite  imagery.  Satellite  data  has  not  proven  to  be 
easily  integrated  into  SCS's  conventional  range  site  and  condition  surveys,  nor  to  the  point 
sample  used  in  SCS  national  inventories  but  it  is  an  approach  of  great  current  inte.est. 

Since  there  will  not  usually  be  "field"  boundaries  in  rangeland  areas  it  will  not  be 
possible  to  match  data  as  precisely  as  in  the  SRS  crop  acreage  approach  or  the  Forest 
Service  approach.  Rectification  of  one  pixel  accuracy  or  registration  at  one  pixel  accuray  if 
repetitive  coverages  are  interpreted  should  be  adequate  in  light  with  the  type  of  ground  data 
available.  As  with  most  other  USDA  applications  registration  or  -ectification  needs  for  new 
sensors  would  continue  to  be  in  terms  of  one  pixel  accuracy  rather  than  a specification  in 
terms  of  absolute  meters. 
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Sampling  vs.  Whole  Frame  Studies 

One  topic  of  interest  to  individuals  concerned  with  registration  anc  rectification  is 
differences  in  requirements  for  sampling  approaches  versus  whole  frame  studies.  From  my 
viewpoint  of  USDA  requirements  I feel  that  the  answer  is  contained  in  the  examples  cited. 
For  estimation  purposes  when  whole  frame  estimates  are  created  in  the  SRS  approach  or 
when  FAS  desires  to  make  estimates  for  areas  without  corresponding  ground  data  positional 
accuracy  of  one  pixel  is  sufficient.  However,  when  sampling  approaches  are  used  such  as 
the  SRS  matching  of  ground  data  with  corresponding  satellite  data  for  training  or  the  USFS 
matching  of  various  ground  data  items  with  satellite  data,  positional  accuracy  is  more 
critical  and  one-half  pixel  or  greater  accuracy  is  needed.  These  accuracy  requirements  are 
relative  to  the  purposes  for  which  the  data  are  used  and  should  be  thought  of  as  related  to 
the  resolution  of  each  sensor  and  not  normally  as  absolute  measures  of  ground  distances. 

Need  for  Standardized  Concepts 

As  a closing  note  I would  like  to  comment  on  observations  from  the  communications 
during  the  past  two  years  and  particularly  from  the  past  few  weeks  in  preparing  for  this 
workshop  Disagreement  in  uelinition  of  terms  was  already  addressed  in  the  opening  of  the 
paper.  I in  within  the  use  of  a particular  definition  I think  there  is  considerable 
misunde  standing. 

An  c 'High  the  term  "RMS"  error  as  in  "40  meters  RMS"  is  widely  used,  I would  question 
if  all  people  ...sing  it  have  the  same  concept  of  how  to  calculate  RMS  error  and  I feel  from 
discussions  many  users  are  misunderstanding  what  is  meant  by  a certain  result.  At  least  as 
used  by  the  Statistical  Reporting  Service  RMS  error  is  a confidence  interval  statement  that 
two-ti  rds  of  all  pixels  will  be  within  plus  or  minus  that  distance  from  "true"  iocation  where 
true  location  may  come  from  another  data  scene  or  frcr  map  locations.  Since  so  much 
emphasis  has  been  placed  on  this  RMS  concept  some  cat.  _sers  may  believe  that  "all"  data 
are  within  this  RMS  bound.  SRS  has  adopted  a procedure  of  calculating  a secor.d  accuracy 
measure,  the  R-90  criterion,  which  is  the  radius  of  a circle  containing  90  percent  of  the 
deviations  of  pixels  from  "true"  locations.  This  is  felt  to  convey  more  information  about  the 
accuracy  of  registration  or  rectification  than  just  the  RMS  calculation.  In  the  Forest 
Service  example  above,  the  data  usfs  are  interested  in  knowing  how  precisely  95  percent  of 
all  points  are  registered  which  is  essentially  a distance  equal  to  twice  the  RMS  measure. 

If  this  workshop  can  publicize  procedures  icr  properly  measuring  or  calculating 
positional  accuracy  and  can  educate  users  as  +o  proper  interpretation  of  accuracy 
statements,  it  will  have  accomplished  a great  deal. 
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Since  little  is  documented  in  U.S.  Department  of  Agriculture  publications  on 
registration  and  rectification  requirements  an  alternate  approach  is  to  provide  a list  of 
references  for  more  information  about  applications  of  the  various  Agencies.  Below  are 
listed  individuals  who  can  be  contacted  for  the  remote  sensing  approachs  mentioned  in  this 
paper. 

Foreign  Agriculture  Service  - Bobby  Spires,  Chief,  Analysis  Branch,  Foreign 
Commodity  Condition  Assessment  Division,  Foreign  Agriculture  Service,  1050  Bay 
Area  Blvd.,  Houston,  Texas  77058. 

U.S.  Forest  Service  - Edgar  Chapman,  Cartographer,  Nationwide  Forestry  Applications 
Program,  U.S.  Forest  Service,  1050  Bay  Area  Blvd.,  Houston,  Texas  77058. 

Soil  Conservation  Service  - Bill  Hance,  Soil  Conservationist,  Inventory  and  Monitoring 
Staff,  Soil  Conservation  Service,  12th  & Independence  Avenue,  S.W.,  5241  South 
Building,  Washington,  D.C.  20250. 

Statistical  Reporting  Service  - Rich  Allen,  Chief,  Remote  Sensing  Branch,  Remote 
Sensing  Branch,  Statistical  Reporting  Service,  12th  & Independence  Avenue,  S.W., 
Room  4832  South  Building,  Washington,  D.C.  20250. 
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4.3  NEEDS  FOR  REGISTRATION  AND  RECTIFICATION  OF  SATELLITE  IMAGERY  FOR 
LAND  use  and  land  cover  and  hydrologic  applications 


Leonard  Gaydos 
d.S.  Geological  Survey 
240-8  Ames  Research  Center 
Moffett  Field,  California  94035 


ABSTRACT 

Many  land  use  and  land  cover  and  hydrologic  applications  require  the 
use  of  satellite  imagery  end  data.  Maps  ana  ^regations  are  made  from 
the  data  which  might  exist  in  concert  with  other  data  in  a geographic 
information  system.  Users  have  basic  needs  for  registration  and 
rectification  of  satellite  imagery  related  to  specifying,  reformatting, 
and  overlaying  the  data.  Presently,  each  user  must  accomplish  these 
tasKS  independetly  because  the  present  data  pre-processing  system  is 
unreliable.  These  data  are  sufficient  for  users  who  must  expand  much 
effort  in  registering  data.  These  users  have  requirements  concerning 
projection,  pixel  size,  resampling,  and  accuracy,  and  most  would  be 
satisfied  with  data  that  met  the  standards  proposed,  but  not  consistently 
achieved,  for  the  present  system. 

APPLICATIONS 

Users  of  satellite  imagery  .Tor  land  use  and  land  cover  or  hydrologic 
applications  generally  are  interested  in  interpreting  land  use  and  land 
cover  from  the  data  to  produce  maps  and  aggregations,  inputting  the  data 
into  geographic  information  systems,  detecting  changes  over  time,  and 
using  derived  data  in  a predictive  fashion  (ORI,  1979).  Ancillary  data 
is  important  in  every  step,  and  the  ability  to  incorporate  such  data  into 
the  analysis  process  directly  increases  utility  for  such  applications  as 
inventorying , managing,  and  planning.  The  hydrologic  application  is 
really  a subset  of  the  more  general  land  use  a J land  cover  applica- 
tions, Frequently,  “"articular  categories  of  land  use  and  land  cover 
affecting  the  hydrologic  buaget  (such  as  irrigated  agricultural  land}  are 
mapped  and  utilized  in  hydrologic  models  (much  like  yeographic  informa- 
tion systems)  with  other  data  sets. 

These  users  interested  in  areas  at  least  as  large  as  multiple  counties 
make  most  use  of  the  present  generation  of  satellite  imagery.  We*ll 
focus  on  one  prospective  user,  the  U.S.  Geological  Survey  (USGS)  to 
illustrate  needs  most  other  users  can  be  expected  to  have. 

USGS  began  a program  in  }~74  to  map  land  use  and  land  cover  for  the 
entire  Nation,  to  digitize  the  resulting  polygons,  and  to  make  the  data 
available  for  use  in  geographic  information  systems.  Although  present 
satellite  data  have  not  been  used  as  primary  source  material,  data  r om 
improved  sensor  packages  may  prove  more  useful.  In  any  case,  sa^  xite 
data  can  be  expected  to  play  a role  in  identifying  areas  ir»  nee^  of 
updating  (Milazzo,  1980),  and  Landsat  digital  data  have  proved  valuable 
in  regions  where  other  source  material  is  lacking  (Morrissey  and  Ennis, 
1981) . 
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The  Water  Resources  Division  of  USGS  has  a need  to  map  specific  cate- 
gories of  land  use  and  land  cover  as  an  indirect  estimator  of  water  use. 
Field  measurements  and  ancillary  data  are  used  to  determine  the  average 
amount  of  water  used  for  each  hectare  of  a given  land  use  and  land  cover. 
The  resulting  data  are  used  in  combination  with  other  layers  of  ata  such 
as  recharge  and  discnacge  rates  and  present  saturated  thickness  or  an 
aquifer  to  predict  future  saturated  thickness  given  alternative  water  use 
plans.  A hydrologic  model  is  used  for  this  application  in  much  the  same 
way  that  a geographic  information  system  might  be  used  to  relate  multiple 
layers  of  data. 


BASIC  WEEDS 

Land  use  and  land  cover  and  hydrologic  applications  users  have  basic 
needs  for  registration  and  rectification  of  satellite  imagery:  (1)  the 

users  must  be  able  to  locate  data  when  given  geographic  coordinates  or  to 
find  geographic  coordinates  given  data  coordinates?  (2)  it  must  oe 
possible  to  reformat  the  data  to  fit  given  map  projections;  and  (3) 
scenes  of  the  same  area  from  different  times  must  overlay  each  other. 

Presently,  each  user  solves  these  problems  independently  with  different 
degrees  of  success  and  at  varying  costs.  Typically  the  user  first  finds 
a set  of  30  or  more  control  points  for  a Landsat  scene  that  can  be 
identified  on  the  imagery  and  on  the  largest  scale  maps  available. 

Methods  differ  somewhat.  Some  users  identify  control  points  from  a 
digital  display.  Others  print  grayscales  for  areas  surrounding  likely 
control  'points  on  a lineprinter  and  correlated  them  with  topographic 
maps.  Map  coordinates  are  determined  either  through  measurement  with  a 
latitude/longitude  ^r  Universal  Tranverse  Mercator  (UTM)  coordinates. 
Second-  or  third-degree  polynomials  are  computed  by  analyzing  the  control 
points  and  discarding  those  inaccurately  determined.  These  polynomials 
are  used  as  a calibration  file  to  reference  the  data.  Other  data  can 
then  be  registered  to  the  Landsat  base  through  the  calibration  file  even 
tnough  that  base  might  not  actually  be  itself  registered  to  a map. 

For  display  of  Landsat  data  as  a map,  though,  additions]  processing  is 
required,  vypically  the  Landsat  data  wili  be  registe~..d  to  a map  base  by 
specifying  a calibration,  desired  projection,  siae  of  final  pixel,  and 
resampling  scheme.  This  precision  reformatting  is  a computation-intensive 
procedure,  and  not  every  user  is  able  to  accomplish  it. 

Utilizir.J  more  than  one  Landsat  scene,  eitner  to  make  w,se  of  temporal 
data  in  an  analysis  or  to  detect  change  with  time,  requires  registration 
of  one  scene  to  another.  Again  there  are  many  ways  to  accomplish  this 
task.  Some  users  use  a modified  version  of  the  control  po*nt  procedure 
used  to  register  a scene  with  a map.  A digital  displ^v  or  grayscales  are 
used  to  find  control  points  on  each  scene,  and  calibration  is  established 
based  on  a polynomial.  A less  labor- intens ive  method  is  to  use  auto- 
correlation techniques,  sometimes  combined  with  gradient  ider.t if icat ion 
techniques,  on  a computer.  This  automatically  finds  control  points  that 
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can  then  be  edited.  In  addition  to  the  labor-saving  advantages,  such 
systems  frequently  are  able  to  find  many  mere  control  points  than  the 
analyst  is  willing  to  find,  say  200  rather  than  50.  Errors  are  usually 
less  with  more  control  After  the  equations  are  established,  one  scene 
is  considered  the  primary  scene,  and  the  other  is  "rubber-sheeted"  to  fit 
it,  another  intensive  computation  job.  Though  many  users  are  interested 
in  using  multitemporal  data  for  analysis,  not  everyone  can  carry  it  out, 
given  the  procedures  required  today. 

PRESENT  LIMITATION 

The  techniques  outlined  to  solve  'present  registration  problems  have  been 
around  for  at  least  5 years.  EDIPS  data  have  been  around  for  2 1/2 
years.  The  same  procedures  used  befote  EDIPS  to  solve  registration 
problems  are  as  necessary  today  c.s  they  were  before  EDIPS  became  avail- 
able. Th' re  was  great  hope  that  the  Master  Data  Prucessor  (MDP)  at 
Goddard  would  alleviate  many  of  the  problems  and  provide  reliably 
corrected  data.  The  Landsat  data  corrected  with  ground  control  points 
(GCP)  chosen  from  1 : 24 , 000-scale  maps  wouxd  be  less  than  one  pixel  for  90 
percent  of  the  pixels  in  a scene.  The  Landsat  Data-Users’  Handbook  also 
specified  that  the  temporal  registration  offsets  between  two  Landsat 
scenes  having  the  same  path-row  location  would  be  less  than  0.5  pixel  for 
90  percent  of  the  pixels  m a scene  (U.S.  Geological  Survey,  1979). 

Those  expectations  are  not  being  net.  The  V.S,  Department  of  Agriculture 
(USOA)  compared  registration  quality  of  data  from  the  MDP  with  fcheir 
existing  techniques  and  found  that  though  they  could  not  rely  on  it 
presently,  they  could  use  data  from  the  MDP  as  a starting  point  for  an 
algorithm  that  will  automat ieally  register  their  segment  data  to  the 
Landsat  data  Graham  and  Luebbe,  1981).  The  Digital  Mapping  of  Irrigated 
Cropland  Technique  Testing  project  found  it  necesrary  tc  manually  find 
control  points  for  36  scenes  in  1981  because  results  of  testirfg  those 
Landsat  seer  us  from  the  High  Plains  with  assessment  ratings  of  three  or 
more  where  an  average  of  no  closer  th-.o  ten  pixels  from  their  expected 
locations  (Koch,  1981) . 

The  same  Technique  Testing  project  found  that  not  only  was  it  necessary 
to  find  control  points  for  scene  to  scene  registration  {multitemporal)# 
but  there  was  more  rotation  of  one  scene  *ith  respect  to  another  with 
w«ta  from  he  MDP  than  there  had  ever  been  before.  The  increase  in 
rotation  requires  much  more  computer  memory  for  the  "rubber  shading" 
aigoithm.  On  the  positive  side,  EDIPS  data  seemed  to  ccrrelat  cetter 
than  the  old  x-formot,  presumably  because  of  the  cubic  convolution 
resampling.  This  improvement  was  also  noted  by  the  California  Irrigated 
Lands  Technique  Testing  project  (E.  Bauer,  oral  commun. , 1981). 

REQUIREMENTS 

The  present  registration  of  Landsat  data  products  ' insufficient  for  the 
needs  <-■,  ^jnd  use  and  land  cover  and  hydrologic  applications  users.  Much 
time  and  tfort  is  expended  in  referencing  the  data  by  map  coordinates, 
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precisica  correcting  it  to  fit  mans,  and  overlaying  mult  iter,  poral  scenes. 
These  steps  could  he  simplified  considerably  and  even  eliminated  for  some 
applications  it  data  was  really  available  in  registered  form.  User 
demands  in  this  arer  are  not  extreme.  It  is  fair  to  presume  that  those 
users  presently  dissatisfied  with  data  registered  by  the  MDP  wouJd  be 
quite  happy  with  data  chat  was  registered  as  well  as  they  are  able  t^ 
obtain  themselves. 

Users  with  the  ability  to  perform  their  own  geometric  corrections  would 
like  Landsat  data  to  come  with  information  on  image  geometry  (like  list- 
ings of  ground  control  points)  sufficient  for  facilitating  geometric 
corrections  (OPI,  1979).  This  is  probably  :e  most  common  demand  heard. 
Users  would  like  listings  of  control  points.  With  then,  they  couiu 
perform  their  own  corrections,  check  out  the  accuracies  of  ui  y ;erw 
corrected  data,  or  use  them  as  a base  for  adding  additional  points  vhe" 
warranted. 

Those  users  who  would  like  system-corrected  data  are  divided  n questions 
of  projection,  rotation,  pixel  size,  resampling,  nnd  accuracy.  Let's 
look  at  each  question,  o~e  at  a time. 

All  users  will  not  be  satisfied  with  data  in  just  one  standard  projec- 
tion, such  ns  the  Space  Oblige*  Mercator  (SOM!  c:  Hot'ine  Cb.ique  Mercator 
(HCM) . Users  of  satellite  imagery  for  land  use  and  land  cover  applica- 
tions commonly  use  the  data  in  combination  with  maps  and  ofV,er  data 
layers.  These  maps  can  be  cast  on  a variety  of  projections,  such  as  che 
rTM,  Albers  Conical  Equal  Area,  or  polar  Stereographic.  What  is  needed 
is  the  ability  to  convert  data  from  one  projection  to  mother.  USTS  does 
have  a package  of  convuter  routines,  in  Fortran,  designed  to  permit  tne 
trausformt ion  cf  coordinate  pairs  from  one  map  projection  to  another 
(U.S.  Geological  Survey,  1931) . Data  could  be  made  available  in  one  cr 
f/o  standard  projections  with  software  ../ailable  to  the  users  o convert 
co  other  projections,  or  the  lice  of  available  projections  could  be 
expanded  for  the  standard  product  with  the  user  specifying  his  choice. 

vest  users  would  prefer  land  use  and  land  cover  data  that  are  geo- 
metrically correct0;  before  delivery  to  them  to  be  rotated  to  North 
Though  arguments  car.  b. ■ made  that  station  is  not  really  neoassary,  the 
fact  remains  that  when  working  with  maps,  and  other  data  levels  derived 
from  maps,  rotated  data  is  a pleasure  and  unrotated  data  is  a oain. 

There  is  a dilemna  wich  respect  to  this  ques*Tor..  When  working  with  an 
entire  Landsat  c^ene  or  multiple  scenes,  a rotated  data  set  is  sub- 
stantially larger  than  its  un rotated  counterpart.  When  wot  king  with  a 
map  quadrangle,  though,  rotated  daca  fit  jus1'  right,  and  substantially 
mo *e  data  ?re  needed  to  get  the  quadrangle  c .rage  iron  the  unro rated 
set.  5o  it  really  depends  on  the  application  and  the  size  of  the  area  of 
concern.  Thu  question  of  rotation  should  really  be  an  option  icr  the 
user.  This  vould  satisfy  all. 

Three  pixel  sizes  seem  to  vAe  for  attention.  The  57-meter  square 
delivered  with  EDIPS  seems  to  garner  no  real  harsh  feelings.  Users 
understand  that  57  meters  is  the  resampling  interval  along  a scan  line 
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and  they  understand  the  logic  of  choosing  that  for  the  resampled  pixel* 
There  are  perhaps  stronger  arguments  to  be  made  for  going  to  a 50-meter 
squajre  pixel  since  it  would  correspond  quite  nicely  to  UTM  coordinates 
and  be  compatible  with  the  cell  size  of  the  USGS  land  use  and  land  cover 
data  in  the  grid  cell  form*  There  are  also  those  who  would  like  to  see 
6C-meter  pixels  which  would  be  easier  to  compare  with  30-meter  thematic- 
mapper  data* 

There  has  also  been  much  disagreement  over  resampling.  Most  users  who  do 
their  own  geometric  corrections  tend  to  use  simple  nearest  neighbor, 
most1*,  because  of  cost  considerations.  Cubic  convolution  does  appear  to 
prov i e smoother  looking  data.  It  does  so  by  increasing  the  variability 
of  the  pixel  values  making  the  data  harder  to  compress  and  perhaps 
adversely  affecting  the  accuracy  of  classification  algorithms  that 
utilize  variance.  Much  of  what  resistance  there  is  to  convoluted  data  is 
probably  due  mor ' to  unfamiliarity  with  it  than  to  other  factors. 

The  question  of  accuracy  is  probably  the  single  most  important  issue.  At 
a minimum,  users  would  like  to  know  what  the  average  accuracy  of  a 
particular  product  is.  This  is  important  above  all  else.  If  it  is 
reasonable  to  achieve  only  10-pixel  accuracy  for  a given  scene,  because 
many  15-minute  maps  had  to  be  used,  the  user  needs  to  know.  He  can  then 
determine  whether  that  accuracy  is  sufficient  for  his  application  and 
improve  upon  it  if  necessary  or  possible.  Perhaps  the  greatest  dis- 
appointment from  the  AgRISTARS  evaluation  of  data  registration  was  the 
poor  correlation  that  was  found  between  accuracy  and  assessment  ratings 
(Graham  and  Luebbe,  1981) . 

There  are  three  distinct  accuracies  the  user  must  worry  about.  The  first 
involves  the  referencing  problem.  It  may  be  necessary  to  extract  pixels 
that  lie  within  polygons  digitized  from  a map.  Most  users  would  tell  you 
that  for  this  they  require  root-mean-square  (RMS)  accuracies  at  least  as 
good  as  1 pixel.  This  can  be  achieved,  however,  in  two  stages.  The 
first  might  reference  the  data  to  within  several  pixels,  while  the  second 
mist  use  local  fit  to  achieve  the  sub-pixel  accuracy  desired. 

For  fitting  the  data  to  a map,  the  real  consideration  is  scale.  The 
National  Map  Accuracy  standard  for  horizontal  accuracy  is  0.02  inches  at 
scales  smaller  than  1:20,000  (Thompson,  1979).  This  translates  to  254 
meters  at  1:500,000,  127  meters  at  1:250,000,  and  51  meters  at  1:100,000. 
Judging  from  past  performance  it  seems  reasonable  to  expect  precision- 
corrected  Landsat  data  to  fall  somewhere  between  the  standards  for 
1:500,000-  and  1: 250 , 000-scale  maps.  This  should  be  quite  acceptable  for 
most  users. 

In  a geographic  information  system  environment,  the  resolution  of  the 
coarsest  unit  determines  the  effective  resolution  of  the  entire  system* 
Since  land  use  and  land  cover  data  are  usually  at  a finer  resolution  than 
other  data  layers,  such  as  soils,  problems  with  inaccurate  registration 
of  a few  pixels  are  not  especially  critical  on  the  whole.  In  hydrologic 
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applications  over  multi-state  regions,  land  cover  data  from  Landsat  may 
be  at  the  finest  resolution  of  the  system  even  though  it  is  reported  for 
areas  as  large  as  1 square  mile*  Misregistration  could  be  critical  in 
particular  cases,  though*  Identifying  residential  land  use  within  a 
specified  slope  interval  computed  from  digital  elevation  models  of 
15-meter  resolution  would  require  very  good,  sub-pixel  registration. 
Registration  becomes  most  critical  when  it  come  to  overlaying  data 
collected  from  the  same  point  at  different  times.  The  California 
Irrigated  Lands  Technology  Transfer  project  attains  a 0.2  pixel  RMS  error 
for  multitemporal  registration  (Wall  and  others,  1981) . Error  tolerance 
depends  mostly  on  environment  and  repetition.  Larger  errors  can  be 
tolerated  if  land  use  and  land  cover  features  are  large  and  if  only  two 
dates  are  being  overlaid.  Those  same  errors  become  intolerable  when  the 
features  are  smaller  (more  boundary  pixels)  and  when  more  scenes  are 
.being  overlaid.  In  general,  most  users  would  be  quite  pleased  with  the 
error  limits  proposed  for  EDIPS,  that  is,  0.5  pixel  temporal  registra- 
tion offset. 

SUGGESTIONS 

Most  users  are  puzzled  by  the  lack  of  quality  registration  coming  out  of 
the  MDP . This  has  limited  some  users  without  access  to  their  own 
geometric  correction  and  overlaying  algorithms  and  has  increased  costs 
substantially  for  the  others.  It  is  hoped  that  a result  of  the  Registra- 
tion and  Rectificaton  Workshop  will  be  an  improvement  in  the  accuracy  of 
MDP  products.  One  critical  element  in  any  procedure  to  accurately 
register  satellite  imagery  to  maps  is  selection  of  ground' control  points. 
Thousands  of  control  points  have  been  picked  by  Landsat  analysts  in  the 
past.  Perhaps  a way  can  be  found  to  accept  contributions  of  GCP's  from 
the  users  into  the  MDP  library.  There  they  would  augment  those  already 
in  the  library,  increasing  the  number  of  points  available  for  each  scene 
and  the  reliability  of  registration. 

SUMMARY 

Reliable  registration  of  satellite  imagery  would  greatly  increase  the  use 
of  such  data  for  land  use  and  land  cover  and  hydrologic  applications. 
While  some  users  can  and  do  accomplish  their  own  registration,  most 
cannot.  The  inability  to  work  with  registered  data  results  in  the  loss 
of  the  tenpoial  dimension,  production  of  inferior  map  products,  and 
difficulty  in  using  ancillary  data  that  is  registered.  While  sampling 
strategies  satisfy  users  from  some  disciplines,  land  use  and  land  cover 
are  commonly  interested  in  completing  "wall  to  wall"  surveys  and  produc- 
ing map  products. 

Land  use  and  land  co^er  and  hydrologic  applications  users  have  definite 
demands  for  registered  satellite  imagery.  While  more  variety  with 
respect  to  cptons  is  desirable,  products  which  meet  the  standards 
proposed  for  ED^S  would  be  welcomed.  One  addition  that  most  users 
mention  io  a listing  of  control  points  that  can  be  used  to  check  accuracy 
of  a particular  r rodrct  or  as  a starting  point  for  refinement.  Satisfac- 
tion of  those  requirements  would  greatly  improve  the  utility  of  satellite 
imagery  for  xand  use  and  land  cover  and  hydrologic  'applications. 
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4.4  REGISTRATION  AND  RECTIFICATION  NEEDS  OF  GEOLOGY* 

Pat  S.  Chavez f Jr. 

Geologic  applications  of  remo  ^ly  sensed  imaging  encompass  five  areas  of  in- 
terest. These  include:  enhancement  and  analysis  of  individual  images;  work 
with  small-area  mosaics  of  imagery  which  have  been  map-projection  rec’ ’fled  to 
individual  quadrangles;  development  of  large-area  mosaics  of  multiple  images 
for  several  counties  or  states;  registration  of  multitemporal  images;  and  data 
integration  from  several  sensors  and  map  sources.  Examples  for  each  of  these 
types  of  applications  are  summarized  in  Tables  1-5. 

Individual  image  work  (Table  1)  has  been  primarily  applied  for  mediun-scale 
structural  mapping  and  surface  geology  delineation.  Small-area  mosaics  (Table 
2)  have  been  developed  primarily  for  structural  analysis  also*  but  the  recti- 
fied image  can  be  considered  a map  product.  Both  optical  (i.e.f  photographic) 
and  digital  rectification  and  edge  matching  have  been  undertaken.  Large-area 
mosaics  (Table  3)  have  been  undertaken  to  provide  geologists  with  regional 
views  that  display  major  tectonic  features.  Until  recently,  most  of  this 
work  has  involved  digital  processing  on  subsampled  Landsat  scenes  (i.e.,  a 
resolution  of  200  meters)  or  optical  processing  for  photomosaics.  Temporal 
processing  (Table  4)  has  been  applied  to  several  imaging  sensors  to  detect 
changes  over  time  associated  with  vegetation  seasonality  and  of  dynamic  phe- 
nomena such  as  ocean  currents  or  ice  flows.  The  last  area  of  concern  is  data 
integration  (Table  5),  in  which  a variety  of  remotely  sensed  and  ancillary 
data  are  map  projected  and  overlain  to  assist  in  the  analysis  of  geologic 
structure.  In  data  integration  studies,  satellite  images  form  a limited  but 
essential  contribution  to  the  overall  analysis.  As  the  various  data  types  are 
being  overlaid,  the  accuracy  of  image  reprojection  to  a given  map  projection 
and  scale  is  of  paramount  importance. 

In  summary  (see  Table  6),  geologists  have  first-order  geometry  corrections 
with  1 to  250,000  scale.  For  the  geologists,  if  you  take  care  of  aspect  ra- 
tio, earth  rotation,  variable  scanning  of  the  mirrors,  unings  you  can  do  auto- 
matically, probably  60%  of  the  time  that  is  acceptable.  But  if  geologists  are 
going  to  do  very  detailed  lithology  and  lineament  mapping,  you  need  to  go  to 
ground  control  points.  For  satellite  ephemeris  corrections,  we  have  tried 
several  of  those  techniques  and  it  never  seems  to  give  the  accuracy  needed, 
probably  because  we  haven’t  been  able  to  obtain  the  ephemeris  information  for 
that  image.  Digital  correlation  techniques  already  exist;  this  is  what  the 
MDP  is  using  and  now  more  recently  the  Purdue  and  JPL  teams  are  using  with  FFT 
techniques.  For  correction  techniques,  we  look  at  image  to  map  and  image  to 
image.  If  you  go  from  an  image  to  one  map  and  then  another,  the  geologist  may 
want  to  convert  from  a UTM  to  an  orthographic  or  other  projection.  This 
brings  out  the  question:  should  we  really  do  the  Landsat  geometry  corrections 
right  at  the  beginning  at  MDP  or  should  you  just  supply  the  coefficient  to  the 
user  so  he  can  adjust  the  coefficients  if  he  would  really  like  to  map  projec- 
tion 2 instead  of  map  1.  This  would  reduce  having  to  resample  the  data  twice. 
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One  of  the  '.hings  that  I feel  may  still  need  improvement  is  the  accuracy  in 
the  terms  of  pixels  rather  than  meters.  If  you  are  working  on  a 1:250,000 
scale  you  could  get  typically  with  Landsat  +1  or  2 pixels.  With  the  Thematic 
Mapper,  of  course,  the  same  distance  would  be  more  pixels  but  now  we  are  going 
to  be  working  with  1:50,000  and  1:100,000  scale  maps,  so  again  the  +1  or  2 
pixels  will  probably  be  sufficient  for  the  geologist.  In  other  words,  if 
what  I am  mapping  has  accuracy  within  the  width  of  my  pencil  line,  that's  all 
I need.  For  digital-mozaicking  accuracy  though,  I think  that  the  geologists 
will  complain  when  they  see  a mismatch  of  one  pixel,  even  if  it  falls  within 
their  accuracy  criteria  from  one  image  to  the  other.  Right  away  they  start 
worrying  that  the  area  of  mismatch  may  be  a lineament,  and  mapping  isn't  as 
accurate  as  it  should  be.  They  don't  realize  that  its  still  within  h^80  or  90X 
of  the  particular  need  that  they  ask  for. 

We  talked  a little  about  band-to-band  registration  problems.  Again,  I would 
like  to  suggest  that  maybe  somebody  ought  to  investigate  the  idea  of  taking 
the  individual  bands,  trying  some  of  the  autocorrelation  techniques  used  to 
select  ground  control  points,  and  registering  an  individual  band  to  your  map, 
and  extending  your  autocorrelation  from  band  to  band  for  further  correction. 
Finally,  I mentioned  the  geometry  vs  radiometry  and  topographic  displacement. 
Goddard  has  its  ground  control  point  library,  and  perhaps  they  could  include 
some  of  the  new  DTM  30-meter  topographic  data  into  their  correlation?  Perhaps 
this  could  be  added  as  another  data  set  for  topography. 
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EXAMPLES  OF  INDIVIDUAL  IMAGE  WORK 


0 SAN  FRANCISCO  PEAKS  AREA 

• STRUCTURAL  MAPPING 

• SELECTION  OF  OPTIMUM  RATIO  COMBINATION  BY  STATISTICAL 
METHODS 

0 DENVER/AUTOLINER  PROJECT 

• STRUCTURAL  ENHANCEMENT  IN  DENVER  AREA 

. DEVELOP  AN  AUTOMATIC  LINEAR  MAPPING  TECHNIQUE 

0 OFFICE  OF  INTERNATIONAL  GEOLOGY 

• SAUDI  ARABIA 

• STRUCTURE 

• MATERIAL  COVER 

• MOROCCO  AND  TUNISIA 

• MATERIAL  COVER 

• HYDROLOGY 
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EXAMPLES  OF  SHALL- AREA  MOSAICS  (QUADRANGLES) 

(digital  and/or  optical) 


0 ALASKA  (13  l°x2°  QUADS  FROM  LANDSAT  MSS/1974-76) 

• digital  mosaics 

• STRUCTURE  AND  MATERIALS  MAPPING 

0 GRAND  CANYON  (4  LANDSAT  MSS  IMAGE  MOSAICS/1978) 

• DIGITAL  MOSAIC  DONE  BY  NASA/GODDARD 

• USGS  FLAGSTAFF  DID  THE  FALSE  AND  SIMULATED  NATURAL 

COLOR  PRODUCTS  AFTER  ATMOSPHERIC  SCATTERING  CORRECTIONS 

• MOSTLY  OVERVIEW  OF  THE  CANYON  AREA  AND  FOR  COMPARISON  WITH 
TOPO  MAP 

0 1-.250K  SAUDI  QUADS  (10  l°x2°  QUADS  FROM  LANDSAT  MSS/1979-80) 

• DIGITAL  MOSAICS 

• STRUCTURAL  MAPPING 

• BLACK  AND  WHITE  BASE  MAP  FOR  GEOLOGIC  MAPPING 

3 SONAR  (GLORIA  SONAR  IMAGES  OF  THE  ATLANTIC/1980) 

• OPTICAL  MOSAIC  OF  30*40  TRACKLINES 

• DIGITAL  MOSAIC  OF  3*5  TRACKLINES 

• PRIMARILY  FOR  STRUCTURE;  BUT  SOME  MATERIAL  TYPES 

0 RADAR  (AIRBORNE  AND  SATELLITE/1979- PRESENT) 

. G-  SCHABE R , ET  AL  (SAN  FRANCISCO  PEAKS  AND  DEATH  VALLEY) 

• WALTER  BROWN;  ET  AL/jPL 
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EXAMPLES  OF  LARGE-AREA  MOSAICS 

(states  and/or  countries) 


0 NEVADA  (1973-74) 

• 32  LANDSAT  MSS  IMAGES 

• DIGITAL 

0 SAUDI  ARABIA  (1978-81) 

. 260  LANDSAT  MSS  IMAGES 

• OPTICAL  MOSAIC  OF  DIGITALLY  PROCESSED  IMAGES 

• STRUCTURE  AND  BLACK  AND  WHITE  BASE  MAP 

° FLORIDA 

• APPROXIMATELY  15  LANDSAT  MSS  I MAGES/USGS-RESTON 

• OPTICAL  MOSAIC 

° ARIZONA 

• APPROXIMATELY  20  LANDSAT  MSS  IMAGES/jPL 

• DIGITAL  MOSAIC 

0 NORTH  AMERICA  PLATE  MOSAIC  (NAM) 

• PROPOSED  PROJECT  OF  APPROXIMATELY  2200  LANDSAT  MSS  IMAGES 

• digital/optical/hybrid 

• STRUCTURE  PLUS  HIGH-QUALITY  DIGITAL  MOSAIC  DATA  BASE 
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EXAMPLES  OF  TEMPORAL  PRUCESSLNG 


0 LANDSAT  MSS 

• FLAGSTAFF  AREA  ~ MONITOR/DETECT  VEGETATION  CHANGES  FOR 
SOILS  TYPE  INFORMATION  AND  SOIL  EROSION 

• C*  ROBINOVE  ET • AL • * ALBEDO  MONITORING  IN  ARID  LANDS 
(REGISTERED  APPROXIMATELY  20*25  LANDSAT  mss  images) 

0 RADAR/SEASAT 

• ASCENDING  VS  DESCENDING  ORBITS  FOR  GEOMETRY  AND  TOPOGRAPHIC 
INFORMATION  BASED  ON  VIEWING  DIRECTION  DIFFERENCE 

• SEA-ICE  DYNAMIC  AND  ICE*FLOE  TRACKING 


0 HCMM 

. OCEAN  rATTERN  AND  LAND  AREAS 

• THERMAL  INERTIA  MAPPING  (K-  WATSON  AND  A*  KAHLE,  ET*  AL*  ) 
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Table  5. 


DATA  INTEGRATION  (MULTI-SENSORS  AND  HULTH1AP  SOURCES) 


0 REDWOODS  PROJECT  (1976-77) 

• DIGITIZED  COLOR  U"2  FOR  ENHANCEMENTS  AND  VE6ETAT ION  jvC. 
MAP 

• GEOLOGY  MAP 

• PROXIMITY  MAP 

• TOPO/SLOPE  MAP 

PURPOSE:  GENERATE  A DERIVATIVE  MAP  THAT  REPRESENTED  THE 

LANDSLIDE/EROSION  POTENTIAL  BASED  ON  THE  INTEGRATED  DIGITAL 
DATA  SETS* 

0 CEMENT  FIELD  (1979-°0) 

• GAMMA-RAY  SPECTROMETRY  - A PARAMETERS 

• AEROMAGNETICS 

• MULTI-FREQUENCY  RESISTIVITY 

• GRAVITY 

• LANDSAT  MSS 

• COLOR  U-2 

• GEOLOGY 

• TOPOGRAPHY 

PURPOSE:  EVALUATE  VISUALLY  AND  STATISTICALLY  THE  CORRELATION 

AMONG  THE  MEASURED  VARIABLES  OVER  A KNOWN  SURFACE  AND  NEAR- 
SURFACE GEOCHEMICAL  ALTERATION  PATTERNS*  IN  THE  STUDY  AREA 
USED,  ANOMALOUS  GEOCHEMICAL  AND  GEOPHYSICAL  SIGNATURES  HAD 
BEEN  PREVIOUSLY  DOCUMENTED*  IT  WAS  AN  AREA  WHERE  HYDROCARBON 
MICROSEEPAGE  HAD  INDUCED  THE  ALTERATIONS* 
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TABLE  5. (continued) 


0 OCEAN  BOTTOM  DATA  SET  (FAMOUS  AREA/1980-81) 

• BATH 

. MAGNETIC 
. GRAVITY 

• PRESENTLY  ADDING  SONAR 

0 MULTI-SENSOR 

• MSS/SEASAT 

• mss/rbv 

• FUTURE  “ MSS/RBV/TM/SPOT 
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TABLE  6 . 

SMMRX 


0 VARIOUS  TYPES  OF  GEOMETRIC  CORRECTION  TECHNIQUES  EXIST 

• FIRST-ORDER  CORRECTION  (l*E*,  AUTOMATIC  CORRECTIONS  ONLY) 

• GROUND  CONTROL  POINT  (GCP)  CORRECTIONS 

• SATELLITE  EPHEMERIS  CORRECTION 

• DIGITAL  CORRELATION  TO  ALREADY  CORRECTED  IMAGE 

0 CORRECTION  TECHNIQUES  CURRENTLY  IN  USE 

• IMAGE  TO  MAP 

• IMAGE  TO  IMAGE 

• IMAGE  TO  MAP  1 TO  MAP  2 

0 IMPROVEMENT  IS  STILL  NEEDED  IN  THE  FOLLOWING  AREAS 

• ACCURACY  VS  COST 

• BETTER  EPHEMERIS  DATA  FOR  MORE  ACCURATE  CORRECTION 

• THIS  WILL  GREATLY  IMPROVE  THE  USE  OF  THE  IMAGES 
BECAUSE  MORE  AUTOMATIC  AND  EASIER  TO  USE  IN  MOSAIC 

• AN  ABSOLUTE  MUST  FOR  SEA-ICE  MONITORING  TYPE  PROJECTS 

• MULTI-SENSOR  AND  MULT  I- RESOLU T I ON  DATA  INTEGRATION 

• NEED  A GOOD  FRONT  END  ( I * E * „ RECEIVING  STATION)  GEOMETRY 
CORRECTION  TO  GET  GOOD  I MAGE “TO- 1 MAGE  MATCHING  FOR  DIGITAL 
AND/OR  OPTICAL  MOSAICS*  CURRENTLY  THE  COST  PER  IMAGE  FOR  A 
GOOD  DIGITAL  MOSAIC  IS  FROM  $800  TO  $2500  PER  IMAGE;  NEED 
TO  GET  THIS  DOWN  TO  $200 

0 Accuracy 

• DEPENDS  OF  THE  RESOLUTION/PIXEL  SIZE  OF  THE  IP  GE  BEING 
USED 

• GENERALLY  FOR  VISUAL  INTERPRETATION  *1*5  PIXEL  ACCURACY  IS 
SUFFICIENT  ( I • E * > WIDTH  OF  A PENCIL  LINE  AS  GORDON  SWANN 
WOULD  SAY) 

• FOR  DIGITAL  MOSAICS  THE  ACCUR.  v NEEDED  IS  MORE  LIKE  ±0.5 
PIXEL 
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1.  Intnxiuction 

Severe  storms  research  is  characterized  by  temporal  scales  ranging  from 
minutes  (for  thunderstorms  and  tornadoes)  to  hours  (for  hurricanes  and 
extra-tropical  cyclones) . Spatial  scales  similarly  range  from  tens  to 
hundreds  of  kilometers,  depending  on  the  phenomenon  being  observed. 

Sources  of  observational  data  include  a variety  of  groind  based  and 
satellite  systems.  As  one  would  expect,  requirements  for  registration  and 
intercomparison  of  data  from  these  various  sources  are  a function  of  the 
research  being  performed  and  the  potential  for  operational  forecasting 
application  of  techniques  resulting  from  the  research. 

This  paper  presents  an  overview  of  the  sensor  characteristics  and 
processing  procedures  relating  to  the  overlay  and  integrated  analysis  of 
satellite  and  surface  observations  for  severe  storms  research.  It  is  based 
on  a review  of  the  literature,  discussions  with  meteorologist  researchers 
in  the  Troposphere  Branch  of  Goddard's  Laboratory  for  Atmospheric  Sciences, 
and  on  experience  in  the  development  of  the  Atmospheric  and  Oceanographic 
Information  Processing  System  (AOIPS) . 

2.  Severe  Storm  Data  Sources 

Data  sources  include  geostationary  satellites,  polar  orbiting  satellites, 
radar,  aircraft,  balloons,  and  meteorological  models.  Satellite,  aircraft, 
and  radar  data  are  frequently  in  image  form,  while  the  remaining  sources 
and  information  derived  from  satellite  imagery  are  either  in  the  form  of 
gridded  fields  or  station  observations.  This  section  surveys  the  major 
data  sources,  identifying  the  information  provided  and  the  spatial  and 
temporal  characteristics. 

2.1  Satellite  sources  - Geostationary  Orbit 

1 2 

Hie  GOES  Visible  and  Infrared  Spin  Scanning  Radiometer  ' (VISSR) 
provides  visible  imagery  showing  cloud  structure  and  patterns,  and  infrared 
imagery  showing  surface  and  cloud  top  temperature.  A full  earth  image  is 
generally  scanned  every  30  minutes,  however,  limited  area  north-south  scans 
may  be  commanded  at  intervals  as  frequent  as  3 minutes.  Analysis  of 
sequences  of  these  images  provides  meansurements  of  cloud  motion  winds  and 
storm  growth  rates.  Spatial  resolution  is  nominally  1 km  visible  and  8 km 
IR  at  the  subsatellite  point,  but  degrades  away  from  that  point  due  to 
curvature  of  the  earth's  surface.  The  IR  resolution  is  approximately  10 
km,  for  example,  at  40°  latitude.  Wind  and  cloud  height  observations 
derived  from  VISSR  are  essentially  randomly  spaced  corresponding  to 
locations  where  cloud  features  can  be  identified. 

An  improved  sensor  based  on  the  VISSR  - the  VISSR  Atmospheric  Sounder  ^ 

(VAS)  is  currently  being  operated  in  a research/evaluation  mode.  A total 
of  12  IR  channels  provide  measurements  of  temperature  and  tumidity 
integrated  over  different  layers  of  the  atmosphere.  When  operated  in  Dwell 
Sounding  mode,  all  12  channels  are  scanned  for  a selected  north-south 
extent.  Because  of  multiple  spin  averaging  to  improve  the  signal  to  noise 
of  the  radiances,  an  area  the  size  of  the  U.S.  requires  approximately  3 
hours  to  image.  Four  IR  channels  may  be  selected  by  grourxi  command  to  scan 
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at  VISSR  rates  (30  minutes  for  full  earth) . This  multi spectral  imaging 
mode  provides  time  sequenced  imagery  of  temperature  and  water  vapor 
patterns  and  motion.  Like  wind  fields  derived  from  VISSR,  temperature  ind 
humidity  profiles  derived  from  VAS  are  generally  randomly  spaced 
observations. 

Earth  location  information  for  the  VISSR  and  VAS  data  is  derived  from 
interactive  identification  of  lancknark  locations  in  visible  imagery. 

The  initial  method  used  was  to  fit  Kepler  orbital  elements  to  direct 
observations  of  satellite  position  and  to  fit  the  parameters  for  ^ r 
spacecraft  attitude  and  sensor  geometry  to  landmark  observations.  ' 

In  1975,  techniques  were  developed  ^ ^ to  derive  both  orbit  and 
attitude  state  from  image  landmarks.  ' Chebyshev  polyonmials  are  now  used 
to  model  spacecraft  position  and  image-sun  angle  as  a function  of  time. 

This  allows  predictive  parameters  to  be  generated  and  thus  Derm its  earth 
location  of  image  features  inmediately  after  acquisition.  The  Chebyshev 
coefficients  have  been  transmitted  by  NQAA  in  the  image  line  documentation 
since  1977. 

The  VAS  navigation  procedure  correlates  prestored  16  x 16  image  chips  to 
locate  landmarks.  Orbit,  attitude  and  camera  biases  are  estimated  using  an 
iterative  weighted  least  squares  technique. 

Comparison  of  image  locations  derived  using  this  model  with  NQAA  „ 
landmark  observations  yields  the  following  statistics  for  residuals:"' 


mean 

a 

pixel 

-0.0055 

1.335 

line 

0.0192 

1.58 

Using  20  landmark  observations  per  day  for  a 3 day  period  allows  navigation 
parameters  to  be  extrapolated  for  48  hours  with  3 pixel  accuracy.  The  mean 
pixel  and  line  error  vs.  prediction  interval  is  shown  in  Figure  1. 

2.2  Satellite  sources  - Polar  Orbit 

Sensors  on-board  polar  orbiters  typically  repeat  coverage  at  12  hour 
periods.  Because  this  is  much  longer  than  time  scales  of  severe  storm 
dynamics,  this  source  of  data  is  not  as  heavily  utilized  as  the  GOES 
sensors.  The  primary  uses  have  been  model  initialization  and  comparison, 
extraction  of  parameters  not  available  from  geostationary  sensors,  and 
comparison  with  geostationary  observations.  TVio  sensor  systems  will  be 
summarized  here  for  illustration  and  comparison. 

The  Electrically  Scanninq  Microwave  Radiometer  (ESMR)  on  Nimbus-6  provides 
radiometric  measurements  in  two  bands  for  two  polar i nations.  The 
instrument  scans  in  a 70°  area  ahead  of  the  spacecraft  motion  with  a 
constant  50  incidence  angle  with  the  earth's  surface.  Nominal  resolution 
is  20  km  cross-track  and  45  km  alona-track.  Multispectra  1 
classification  techniques  are  used  tc  identify  areas  of  rainfall. ^ 
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Figure  1.  Line  and  pixel  navigation  prediction 
error  for  GOES  VAS. 
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Four  instruments  on  the  TIROS-N  and  NQAA-6  satellites  provide  ^ 
visible  and  infrared  imagery  along  with  sounding  radiances. 

The  Advanced  Very  High  Resolution  Radiometer  (AVHRR)  scans  a 1650  km  swath 
in  4 visible  and  infrared  bands.  The  1.1  km  IFOV  is  oversampled  by  a 
factor  of  1.362  to  produce  2048  samples  per  line  at  approximately  800  meter 
separation.  NQAA  generates  latitude/longitude  values  every  40  pixels  (51 
points  per  line) . 

The  High  Resolution  Infrared  Radiation  Sounder  (HIRS/2)  scans  a 2240  km 
swath  in  20  infrared  bands.  The  56  step  scan  produces  IFOV's  of  17.4  km  at 
nadir,  degrading  to  58.5  km  (cross-track)  by  29.9  km  (along-track)  at 
maximum  scan  angle.  NOAA  generates  latitude/longitude  values  for  each  scan 
position. 

The  Stratospheric  Sounding  Unit  (SSU)  and  Microwave  Sounding  Unit  (MSU) 
scan  in  8 and  11  steps  respectively,  resulting  in  IFOV's  exceeding  120  km. 

2.3  Aircraft  and  Ground  Based  Observations 

Aircraft  flights  are  used  to  measure  smaller  scale  cloud  properties  and  to 
test  new  sensors.  The  scanning  resolution  depends  on  the  instrument  and 
aircraft  altitude.  The  Cloud  lop  Scanner,  for  ~xample,  has  a 100  meter 
cross  track  resolution  and  a 200  meter  along-t  ck  resolution.  Aircraft 
navigation  data  is  used  to  define  image  georeferencing  parameters. 

Ground  based  digital  radar  provides  measurements  of  rainfall  intensity  and, 
for  doppler  radars,  velocity.  Digital  returns  are  oriented  along  radial  scans 
with  varying  range,  range  resolution,  and  azimuth  angle  resolution.  The 
Norman,  Ok.  doppler  radar  for  example  has  a range  of  456.2  km,  range  gate  q ^ 
resolution  of  0.6  km,  and  azimuth  angle  resolution  of  approximately  0.8°. 
Elevation  angle  is  varied  to  provide  measurements  at  different  altitudes. 

Rawinsonde  balloons  provide  measurements  of  temperature,  altitude,  dewpoint 
and  winds  at  40  mandatory  pressure  levels  from  over  100  stations  in  the  U.S. 
every  12  hours. 

3.  Registration  Requirements 

Data  registration  processing  for  severe  storms  studies  tends  to  have  both 
multi-tenporal  and  multispjectral  aspects.  As  mentioned  in  the  discussion  of 
the  VISSR,  multi-temporal  imagery  from  a single  sensor  is  frequently  used  to 
extract  measurements  of  atmospheric  motion  and  cloud  growth.  The  resulting 
observations  are  often  registered  and  overlayed  on  visible  imagery  from  a 
single  time  for  comparison  with  cloud  features  and  are  registered  and 
integrated  with  other  sources  (e.g.,  ground  based  observations)  for  comparison 
or  integration  with  models.  Examples  of  multi-source  image  registration 
include  GOES-west  to  GOES-east  for  direct  stereo  cloud  top  measurements,  and 
digital  radar  to  GOES  visible  and  IR  for  comparison  of  rainfall  and  doppler 
velocities  with  cloud  structure.  These  multi-source  observations  from 
different  times  are  then  registered  to  produce  time  lap>se  displays  and 
temporal  analyses.  Because  of  its  frequent  coverage,  its  ability  to  show 
mesoscale  features,  and  the  computional  time  required  to  remap  sequences  of 
images  to  a common  projection,  the  GOES  imagery  is  generally  used  as  the 
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reference  coordinate  system  or  map  base  for  these  analyses.  Because  of  its 
relativv-  importance,  the  accuracy  and  remapping  considerations  of  GOES 
sensors  will  be  addressed  further  in  the  next  subsection.  Next,  some 
considerations  involving  point  source  and  gridded  field  registration  will  be 
discusser.  Finally,  in  the  next  section,  the  current  multi-source 
combinations  will  be  summarized. 

3.1  GOES  Data  Registration 

As  described  in  Section  2.1,  the  absolute  navigation  accuracy  from  current 
VISSR  and  VAS  lancknark  processing  is  on  the  order  of  1 to  2 pixels  (1-3  km) . 
Errors  may  be  introduced  by: 

- operator  errors  in  the  identification  and  correlation  of 
landnarks, 

- geometric  irregularities  in  the  image,  and 

- differences  between.-  the  oblate  spheroid  model  and  the  actual 
earth's  surface. 

For  registration  of  successive  image  frames,  relative  errors  are  typically  on 
the  order  of  a single  pixel.  In  measurement  of  cloud  drift  winds,  this 
equates  to  an  error  of  approximately  0.5  m/sec  for  30  minute  interval  data  and 
3 m/sec  for  5 minute  interval  data. 

Stereo  measurements  of  cloud  top  heights  are  made  by  remapping  512  x 512  image 
sectors  from  one  GOES  satellite  to  the  projection  of  another.  The 
orbit/attitude  coefficients  define  a (latitude,  longitude)  to  (line,  pixel) 
remapping  function  and  its  inverse.  This  is  used  to  generate  a remapping 
grid,  with  bilinear  interpolation  used  to  relate  corresponding  locations 
between  grid  points.  Absolute  georeferencing  errors  are  reduced  by  shifting 
registered  images  to  align  cloud  shadows  and  other  features.  The  resulting 
relative  error  is  on  the  order  of  a 2 pixel,  with  a resulting  absolute  cloud 
height  error  on  the  order  of  0.5  km. 

Digital  radar  data  is  registered  to  GOES  Visible  and  IR  imagery  through  a two 
step  process.  Data  in  radial  scan  orientation  (B  scan)  is  first  resampled  to 
an  earth  latitude,  longitude  grid.  Plane  earth,  low  elevation  and  short  range 
approximations  are  used  where  possible  to  reduce  computation  time  in 
transforming  from  the  radar  to  earth  coordinate  system.  These  approximations 
introduce  an  error  on  the  order  of  0.5  km  (one  half  a GOES  visible  pixel). 
Next,  the  image  in  this  earth  latitude,  longitude  projection  is  remapped 
to  the  GOES  projection.  Bilinear  interpolation  is  used  to  compute  j. 

positions  between  user  specified  grid  points  (usually  at  20  pixel  spacing) . 

Polar  orbiter  data  is  not  generally  registered  to  GOES  data  for  severe  storms 
observations,  partially  due  to  the  disparate  time  scales  and  partially  due  to 
the  representation  of  the  polar  orbiter  image  location  information  as 
latitude,  lonqxLude  values  at  sampled  locations  along  scan  lines.  The  latter 
makes  the  (line,  pixel)  to  (latitude,  longitude)  transformation  trivial,  but 
makes  the  inverse  transformation  difficult  to  solve.  It  is  therefore  easier 
to  register  data  using  the  polar  orbiter  image  as  a base. 
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3.2  Point  Source  and  Gridded  Field  Registration 

Point  source  or  station  observations  (e.g.,  winds  from  VISSR,  soundings  from 
VAS,  and  rawinsondes)  have  known  locations  and  can  easily  be  overlayed  on  maps 
or  GOES  imagery.  However,  further  analysis  and  comparison  with  image  features 
frequently  requires  gridded  fields  for  contouring  or  diagnostic  (e.g., 
divergence)  computation.  Furthermore,  integrated  analysis  of  multiple 
parameters  requires  that  all  parameters  be  represented  in  the  same  grid 
locations.  A number  of  techniques  are  used  to  interpolate  between  point 
source  observations  to  compute  values  at  intermediate  grid  points.  These 
techniques  include  weighting  values  by  inverse  distance  within  a search  area, 
eliminating  points  that  are  shadowed  by  closer  points,  and  interactive  schemes 
that  recompute  weights  based  on  residual  errors  between  original  point  values 
and  values  interpolated  from  the  gridded  field.  The  selection  of  technique 
and  algorithm  parameters  affects  the  degree  to  which  the  gridded  field 
represents  features  in  the  data. 

4.0  Summary  and  Recommendations 

Current  multi-source  and  multi-temporal  registration  requirements  are 
summarized  below: 

Multi-temporal 

- GOES  VISSR  and  VAS  image  frames  to  first  image  of  a sequence 

- Station  observations  and  gridded  fields  to  GOES  image  loops  and 
to  map  projections 

Multi-source 


- GOES  VISSR/VAS  - west  satellite  projection  to  east  satellite 
projection  (or  the  reverse) 

- Digital  radar  to  GOES  VISSR/VAS 

- Station  observations  and  gridded  fields  to  GOES  VISSR/VAS 

Because  the  GOES  image  projection  generally  serves  as  a common  base, 
registration  accuracy  requirements  are  generally  1 km  (1  visible  pixel) . 

Registration  of  the  above  data  for  research  case  studies  generally  allows 
sufficient  time  for  the  remapping  process.  For  nowcasting  applications 
as  wi)l  be  performed  on  the  Centralized  Storm  Information  System  (CSIS) , 
the  registration  and  overlay  must  be  performed  in  minutes. 

While  the  above  capabilities  for  data  registration  are  fairly  powerful, 
limitations  still  exist: 

(1)  Absolute  errors  on  GOES  VISSR  image  are  as  high  as  6 pixels.  It  is  not 
clear  whether  improved  models  or  procedures  can  improve  this.  Furthermore, 
non-linearities  are  observed  in  short  interval  images  that  are  not  found  in  30 
minute  data  and  are  therefore  not  modeled  in  the  navigation  function. 
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(2)  Stereo  GOES  image  pairs  are  currently  offset  interactively  to  compensate 
for  absolute  navigation  errors.  Registration  using  relative  control  points  in 
the  two  images  may  improve  the  registration  accuracy  and  thus  the  accuracy  of 
cloud  height  measurements. 

(3)  The  incorporation  of  a new  data  source  (e.g.,  a polar  orbiting  sounder) 
into  an  analysis  requires  the  development  of  additional  software  to  identify 
and  extr^’t  image  control  points  and  to  perform  the  necessary  resampling  and 
remapping  to  the  reference  map  projection.  It  is  also  extremely  difficult  to 
experiment  with  map  projections,  resolutions,  and  resampling  functions.  An 
interactive  "geographic  information  system"  is  needed  that  allows  selection  of 
map  projection,  resolution,  data  sources,  and  resampling  function  for  each 
source.  Image  georeferencing  function  implementations  are  needed  for 
different  data  sources  that  embody  approximations  for  computational  efficiency 
while  maintaining  required  geographic  accuracy.  Finally,  the  system  interface 
should  provide  for  straightforward  addition  of  new  sources  in  terms  of  format 
and  image  location  parameters. 
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REGISTRATION,  RECTIFICATION,  and  DATA  INTEGRATION  REQUIREMENTS 
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INTRODUCTION 

Oceanographic  remote  sensing  is  still  in  its  beginning  stages  of  develop- 
ment. Results  from  the  early  meteorological  satellites  suggested  that  para- 
meters of  oceanographic  interest,  such  as  sea  surface  temperatures,  might 
readily  be  obtained  by  satellite  remote  sensing.  The  accuracy  of  the  data, 
however,  was  found  to  be  unacceptable.  Later  instruments,  such  as  those  flown 
on  Seasat^,  demonstrated  the  feasabllity  of  obtaining  nearly  all-weather 
ooservstlons  of  wind  speed  and  direction,  wave  height,  sea  surface  temperature 
and  elevation.  These  data,  along  with  those  obtained  by  the  latest  generation 
of  we'  her  satellites,  appear  to  be  of  much  greater  utility.  The  relatively 
limited  experience  with  these  systems,  however,  places  much  of  oceanographic 
remote  sensing  at  a stage  where  results  are  still  being  verified  and  evaluated. 
Calibrated  geophysical  parameters  are  available  for  many  of  the  data  items,  but 
the  quality  and  significance  of  these  observations  is  only  now  beginning  to  be 
understood. 

There  are  many  reasons  why  oceans  remote  sensing  has  lagged  behind 
meteorological  and  terrestrial  applications.  They  cannot  all  be  addressed 
here,  but  a significant  impediment  has  been  the  lack  of  appi-opriate  tools  for 
acquiring,  processing  and  analyzing  remotely  sensed  data.  Until  very  recently 
only  a few  oceanographic  institutions  had  any  semhlance  of  an  image  processing 
capability  - a capability  which  is  mandatory  for  processing  and  viewing  image 
data  and  extremely  rseful  for  processing  and  displaying  nonimage  data.  This 
lack  of  computerized  tools  for  remotely  sensed  data  processing,  especially  data 
integration,  has  been  an  impediment  to  algorithm  development  and  sensor 
verification.  The  lack  of  appropriate  mechanisms  for  acquiring  the  data 
continues  to  cause  problems  but  is  currently  being  addressed,  to  a limited 
degree,  by  the  Ocean  I Hot  System^. 

Firm  data  integration  requirements  are  difficult  to  pin  down.  Operational 
applications  are  in  the  best  position  to  dictate  data  integration  requirements, 
but  operational  oceanographic  applications  usually  require  real-  or  near-real- 
time  data.  Data  integration  services,  which  are  generally  quite  time 
consuming,  are  therefore  precluded.  For  this  reason,  data  integration  is 
largely  a problem  pertinent  to  research  oceanography  and  requirements  of 
research  projects  vary  widely  in  the  requirements  area.  With  the  launch  of 
Seasat  in  1978  and  with  the  improved  accuracy  and  availability  of  data  from 
meteorological  satellites,  ocean  remote  sensing  is  entering  a period  in  which 
the  necessary  analysis  tools  are  being  built  and  investigators  are  becoming 
more  familiar  with  the  various  sensor  systems.  This  should  lead  to  more 
investigator  concern  with  data  integration  requirements  for  scientific  and 
operational  purposes. 

Table  1 presents  a summary  of  the  primary  satellite  sensors  of  interest  to 
oceanography.  (See  also  Wilson^.)  Since  microwave  sensors  are  so  prevalent, 
resolving  the  different  IFOVs  and  subsatellite  coverages  becomes  extremely 
difficult.  All  presently  operating  oceanographic  satellites  primarily  contain 
imaging-type  sensors.  Thi  .nakes  image  processing  an  important  tool  for 
present-day  oceanographic  studies. 
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TABLE  1 

Summary  of  sensors  of  primary  interest  to  oceanographers 
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NOTE:  Nimbus-7  and  NOAA-6  and  7 are  the  only  currently  operational 

satellites 

• NOAA-6  and  TIROS-N  contain  only  4 channels 
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REQUIREMENTS 


Data  .Integration  requirements  for  oceanographic  remote  sensing!*1  *6*7  can  be 
placed  in  several  categories.  Comparison  of  one  observation  with  another  at 
the  same  geographic  location  is  Important  as  it  is  in  all  disciplines.  Obser- 
vations must  be  earth-located  and  interpolated  in  order  to  either  initialize  or 
test  numerical  models.  Observations  must  be  earth-located  to  measure  magnitude 
and  motion  of  features.  Finally,  observations  must  be  located,  interpolated, 
and  map-projected  in  order  to  provide  maps  depicting  two-dimensional 
distributions. 

Comparison  of  observations  is  an  important  aspect  of  not  only  disciplinary 
research  but  also  sensor  validation.  Observations  of  a physical  phenomenon 
from  a given  sensor  need  to  be  compared  with  observations  of  the  same 
phenomenon  from  other  sensors  which  may  be  on  the  same  satellite,  on  a differ- 
ent satellite  or  on  an  aircraft  platform.  High-rate  obser /ations,  such  as 
AVHRR  sea  surface  temperatures  (1  pixel  - 0.8  km)  need  to  be  compared  with 
other  observations  of  the  same  parameter  from  a low-rate  sensor  such  as  Seasat 
SMMR  (1  pixel  - 18  x 28  km). 

The  different  IFOV  sizes  and  shapes  and  sensor  coverages  on  even  the  same 
satellite  make  observations  difficult  to  compare  (See  Table  1).  Added  to  this 
is  the  fact  that  the  ocean  is  a dynamic  system  so  that  comparisons  of  observa- 
tions taken  at  different  times  (even  a few  hours  apart)  require  temporal 
interpolation  as  well  as  spatial  interpolation  before  valid  comparisons  can  be 
made. 

Correcton  of  one  sensor  with  data  frca  another  leads  to  an  additional 
integration  requirement.  A single  sensor  is  often  incapable  of  making  all  the 
measurements  necessary  to  derive  a particular  geophysical  parameter.  For 
example,  to  make  efficient  path-length  corrections  to  the  Seasat  Altimeter  sea 
surface  elevation  measurements,  Seasat  SMMR  water  vapor  content  estimates  are 
used  where  available.  The  SMMR  is  also  used  to  adjust  scatterometer  (SASS) 
returns  for  atmospheric  attenuation  effects.  If  an  outside  correction  source 
is  on  a different  satellite  or  even  in  an  entirely  different  form  (e.g.,  map 
form)  the  data  integration  problem  becomes  even  more  acute. 

Feature  Identification,  measurement  and  movement  tracking  requires  earth- 
located  data.  Examples  of  these  operations  are  found  in  the  current  warm  ring 
analyses®* 9 bein^  performed  at  several  institutions.  Satellite  projections  do 
not  allow  distance  measurements  in  the  image  in  line  and  sample  coordinates. 

A transformation  from  line  and  sample  to  geographic  coordinates  (lati- 
tude/longitude) must  be  obtained  and  used.  It  is  also  necessary  to  compute 
this  transformation  to  measure  feature  movement  through  time.  The  dynamic 
ocean  system  precludes  simple  scene/scene  registration  and  simple 
differencing. 

The  two-dimensional  display  of  sensor  observations  implies  mapping.  Users 
are  accustomed  to  reading  maps  with  specific  oi  'entations,  projections,  and 
cartographical  characteristics.  Satellites  have  yet  to  provide  maps  directly 
which  satisfy  these  predictions.  In  fact,  many  satellite  projections  are  so 
distorted  that  it  is  unreasonable  to  expect  investigators  to  become  accustomed 
to  them.  It  becomes  necessary,  therefore,  at  some  stage  of  analysis,  to  place 
the  data  into  a suitable  map  projection  and  create  a map  using  conventional 
cartographic  methods  (albeit  automated). 
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Mapping  of  imagery  data  3eems  fairly  straightforward.  However,  it  is 
also  important  to  create  maps  which  are  based  on  data  from  nonimaging  sensors 
such  as  the  Seasat  Altimeter3.  (See  Figure  1.)  Thes  * data  are,  in  general, 
randomly  spaced.  For  a number  of  reasons,  a particular  sample  may  be  mi;- sing 
or  unreadable.  Interpolation  techniques  for  establishing  a reasonable  va'ue 
are  needed.  Alternatively,  cartographic  techniques  are  require.  /-or 
indicating  missing  values,  yet  providing  an  easily  readable  map.  Oceai 
ographers  are  concerned  not  only  with  two-dimensional  distributions  but  also 
with  three-'dimensional  distributions  shown  either  synoptically,  time  s :eiaged, 
or  as  a time  continuum.  The  only  effective  way  to  display  the  four- 
dimensional information,  as  the  latter  requirement  implies,  is  via  anicat.-  m 
The  art  and  science  of  computer  graphics  provides  the  technological  base  for 
animation.  It  is  necessary,  though,  to  map-project,  register,  temporally  and 
spatially  interpolate,  and  reformat  the  data  tc  take  advantage  of  that  techno- 
logy. 

Positional  accuracy  requirements  for  oceanography  are  not  as  stringent  as 
for  terrestrial  remote  sensing  but  are  more  in  line  with  meteorological  .ppli- 
cations.  Using  present  navigation  (earth-location)  techniques  for  polar- 
orbiting  image  data  sets2,  accuracies  are  adequate  for  all  but  micro-  and  fine- 
scale  studies.  Open-ocean  positional  confidence  is  probably  within  5 
kilometers  with  accuracy  being  within  a kilometer  near  landmarks.  These 
accuracies  are  adequate  for  macro-  and  mesoscale  studies.  Additional  posi- 
tional accuracy  in  open-ocean  areas  would  enable  much  more  activity  in  fine- 
scale  research.  Table  2 presents  the  spatial  scales  associated  with  various 
classes  of  oceanographic  research. 


l_ 

RESEARCH 

i 

i 

i 

i 

FEATURE  SIZE 

macroscale 

i 

i 

i 

global 

mesoscale 

i 

10-1000  km 

fine- scale 

i 

i 

2-5  km 

microscale 

i 

i 

j 

< 1 km 

TABLE  2 

Comparison  of  oceanographic  rerarch  areas  and  spatial  scales. 


AREAS  FOR  RESEARCH  AND  DEVELOPMENT 

Data  integration  is  a problem  for  oceanography  just  as  for  any  other 
discipline.  Areas  where  progress  is  needed  include  technique  development  and 
evaluation,  understanding  requirements,  and  packaging  techniques  for  speed, 
efficiency  and  ease  of  use.  Some  specific  topics  for  futher  research  anu 
development  are  p.-esented  below. 
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TECHNIQUE  EVALUATION  AND  DEVELOPMENT 


Evaluate  techniques  for  establishing  geophysical 
values  in  areas  of  missing  data. 

Evaluate  techniques  for  temporal  interpolation. 

Compare  and  evaluate  alternative  navigation  strategies. 

Develop  algorithms  for  automated  coastline  detection  and  correla- 
tion with  vector-coded  coastline  data  (e.g.,  Vorld  Data  Banks  I 
and  II). 


FURTHER  DEVELOPMENT  OF  REQUIREMENTS 

- Define  spatial  scale  requirements  for  fine-scale  studies. 

- Define  requirements  for  band-to-band  registration  of  multiband 
imagery. 

- Define  requirements  for  muitisensor  data  integration,  where 
sensors  may  be  on  the  same  satellite,  a different  satellite,  or 
on  aircraft  and  satellites. 

- Define  data  integration  requirements  for  operational  applications. 

PACKAGING  AND  SYSTEM  DESIGN 

- Produce  a well-organized,  efficiently  accessed,  coastline  and 
landmark  file  for  use  in  interactive  adjustments  to  navigation 
parameters. 

Develop  automated  methods  of  acquiring,  managing,  and  utilizing 
orbital  parameters  and  clock  adjustments  provided  by  tracking 
facilities. 

- Develop  analysis  systems  with  user-friendly  interfaces  enabling 
researchers  to  routinely  perform  data  integration  tasks  in  a 
short  period  of  time.  . aese  systems  would  also  provide  the  basis 
for  evaluating  new  integration  techniques  as  they  are  developed 
in  research  activities. 

Provide  transportable  software  so  that  toe  minimum  amount  of 
effo. t has  to  be  expended  in  duplicating  data  integration 
capabilities  at  various  sites.  This  is  important  because  the 
research  nature  of  oceanographic  remote  sensing  data  integration 
implies  decentralized  activities.  Also,  the  wide  variety  of 
sensors  of  interest  suggests  that  centralized  data  integration 
capabilities  will  not  exist,  at  least  until  full-scale  discip- 
linary data  systems  are  built. 
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5.0  PRESENTATIONS  ON  SPACE  SEGMENT  ERRORS 

5.1  SUMMARY 

It  was  the  purpose  of  the  space  segment  errors  analysis  to  first  give  a brief 
overview  of  the  individual  sensor  system  design  elements  considered  to  be  ja 
priori  components  in  the  registration  and  rectification  process;  and  second, 
provide  an  analysis  of  the  potential  impact  of  error  budgets  on  multitemporal 
registration  and  side-lap  registration.  The  presentations  reviewed  the 
properties  of  scanner,  MLA,  and  SAR  imaging  systems.  Each  sensor  displays  in- 
ternal distortion  properties  which  to  varying  degrees  make  it  difficult  tc 
generate  on  orthophoto  projection  of  the  data  acceptable  for  multiple-pass 
registration  or  meeting  national  map  accuracy  standards.  Each  sensor  also  is 
affected  to  varying  degrees  by  relief  displacements  in  moderate  to  hilly  ter- 
rain. Nonsensor  related  distortions,  associated  with  the  accuracy  of  ephemer- 
is  determination  and  platform  stability,  also  have  a major  impact  on  local 
geometric  distortions.  It  was  for  this  reason  that  a review  of  platform  sta- 
bility improvements  expected  from  the  new  Multi-Mission  Spacecraft  series  and 
improved  ephemeris  and  ground  control  point  determination  from  the  NAVSTAR/ 
Global  Positioning  Satellite  systems  were  reviewed. 
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5.2  SPACEBORNE  SCANNER  IMAGING  SYSTEM  ERRORS 
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There  are  various  stages  and  forms  of  error  in  a spaceborne  scanner  imaging 
system.  The  instrument,  in  this  case  consisting  of  the  spacecraft  and  its 
sensors,  is  designed  to  behave  in  a nominal  or  ideal  way.  In  real  operating 
conditions,  there  are  deviations  from  this  nominal  behavior.  These  deviations 
are  a source  of  error  not  only  as  independent  entities  but  because  of  the  in- 
terdependence of  the  various  components  of  the  instrument.  Thus,  deviation 
from  design  of  one  parameter  may  cause  another  to  display  nonoptimal  behavior. 

The  deviations  mentioned  above  are  large  enough  that  if  they  are  ignored  in 
subsequent  processing  on  the  ground,  the  resulting  images  will  be  distorted 
and  misregistered  to  unacceptably  high  levels.  Therefore,  direct  or  indirect 
measurement  of  deviations  in  instrument  performance  is  necessary.  Inaccura- 
cies in  measurements  form  a source  of  error  which  ultimately  filter  through  to 
the  output  image  along  with  ground  processing  errors. 

In  this  paper  we  will  discuss  errors  due  to  deviation  from  ideal  instrument 
performance  and  due  to  the  measurement  system.  The  discussion  will  be  within 
the  Landsat-D  system  framework  which  consists  of  the  spacecraft  and  two  scan- 
ner type  sensors — the  Thematic  Mapper  (TM)  and  the  Multispectral  Scanner  (MSS) 
[1,2]. 


Whatever  the  source  of  error  in  the  instrument,  when  it  propagates  through  to 
the  image  the  error  can  be  classified  as  either  radiometric  error  or  geometric 
error.  On  ground,  it  is  difficult  to  distinguish  between  these  two  forms  of 
error  but  from  the  point  of  view  of  the  instrument,  there  is  no  iifficulty  in 
making  this  classification.  In  this  paper  we  discuss  only  those  instrument 
components  which  contribute  to  geometric  error,  because  radiometric  error  is  a 
function  of  parameters  that  are  largely  independent  of  the  instrument  being  a 
scanner  type  or  not. 


Geometric  error  implies  lack  of  accurate  knowledge  of  the  position  of  a sam- 
ple. To  place  a detector  sample  of  the  spacecraft  sensor  precisely  on  ground, 
one  needs  to  know  the  time  the  sample  was  taken,  the  position  of  the  space- 
craft, its  orientation  (in  inertial  space)  and  the  orientation  of  the  sensor 
body  with  respect  to  the  spacecraft  all  at  that  same  time.  These  are  the 
platform  or  spacecraft  components  of  the  imaging  system  that  need  to  be  known. 
In  addition,  the  sensor  characteristics  and  dynamics  need  to  be  known  for  all 
time.  Other  important  components  which  will  not  be  specifically  discussed 
here  are  earth  shape,  spin,  atmospheric  effects,  etc. 


The  next  section  discusses  the  platform  errors  and  Section  III  covers  the  sen- 
sor errors.  For  convenience.  Table  1 shows  the  units  often  used  intetjrfiaoge- 
ably  in  describing  the  errors.  ^ 

II.  PLATFORM  ERRORS  [7.8,9,11] 

With  the  exception  of  spacecraft  jitter,  all  platform  errors  vary  slowly 
(low-frequency  error)  with  respect  to  the  time  required  to  collect  data  for 
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one  image.  The  direct  effect  of  these  errors  on  the  image  is  a shift  or  reg- 
istration error  as  opposed  to  distortion  of  features  within  an  image.  We  now 
discuss  the  four  components  of  platform  error  individually,  remembering  that 
the  Landsat-D  System  framework  is  assumed. 

Time  [7] 

The  spacecraft  clock  is  updated  once  every  24  hours  from  the  ground.  The  ac- 
curacy of  tha  updated  time  is  +3  milliseconds.  In  a 24-hour  period,  the  clock 
can  also  drift  by  a maximum  of  +17  msecs.  Thus  a maximum  of  +20  msec  inac  ur- 
acy  can  build  up  in  the  spacecraft  clock  This  time  error  is  essentially  a 
bias  for  any  one  image  and  may  be  treated  as  a spacecraft  or  image  position 
knowledge  uncertainty. 

Ephemeris  [7,8,9] 

The  nominal  spacecraft  orbit  parameters  and  deviations  from  them  are  shown  at 
the  bottom  of  Table  2.  At  the  top  of  the  table  is  shown  the  error  incurred  in 
measuring  the  spacecraft  ephemeris.  This  is  the  measurement  error  incurred 
when  ephemeris  information  is  uplinked  from  the  ground.  In  the  GPS  modes, 
these  errors  would  reduce  substantially.  The  along-track  and  cross-track  po- 
sition error  directly  results  in  an  image  registration  error,  whereas  the  al- 
titude deviation  causes  the  ground  projected  pixel  size  to  vary. 

Attitude  [7,8,9,10,11] 

The  nominal  attitude  of  the  spacecraft  implies  geocentric  pointing  of  the  sen- 
sor optical  axis.  For  the  Landsat-D  TH,  the  attitude  errors  are  shown  in 
Table  3.  along  with  jitter  errors  (which  are  high-frequency  attitude  errors). 
The  spacecraft  attitude  control  is  in  error  by  36  arc  sec  [1].  This  is  a 
low-frequency  error,  as  shown.  The  TDRSS  antenna  d"ive  interacts  with  the 
spacecraft  structure  and  causes  attitude/ jitter  error  of  the  magnitude  shown. 
It  should  be  noted  that  most  of  this  error  is  in  the  lower-frequency  range  and 
can  be  measured  by  the  gyros. 

High-frequency  jitter  in  the  spacecraft  is  caused  by  the  scanners  themselves. 
Odd  harmonics  of  the  scan  mirror  frequency  (7  Hz  for  the  TH  and  13-62  Hz  for 
the  HSS)  are  fed  back  to  the  sensors  through  the  spacecraft  structure.  An  an- 
gular displacement  sensor  (ADS)  is  used  to  measure  tr.is  jitter  on  the  TM  sen- 
sor. In  Table  3,  the  baseline  and  the  worst  case  design  values  for  jitter  in 
the  roll,  pitch,  and  yaw  axis  is  given.  Error  in  ADS  and  DRIRU  (dry  rotor 
inertial  reference  unit)  calibration  causes  measurement  error  in  attitude/ 
jitter. 

Alignment  [7,8] 

The  spacecraft  assumes  a predetermined  alignment  between  the  pointed  axis  and 
the  master  reference  cube  in  order  to  achieve  proper  pointing.  This  predeter- 
mined alignment  can,  however,  be  achieved  to  within  only  a certain  tolerance, 
and  the  real  alignment  can  be  measured  to  only  a certain  accuracy.  The  values 
are  shown  in  Table  4.  Another  error  source  in  alignment  is  the  fact  that  it 
does  not  remain  constant.  There  is  a dynamic  component  to  it  caused  mainly  by 
thermal  bonding  due  to  spacecraft  temperature  changes.  The  static  error  com- 
ponent of  alignment  results  in  the  sensor  pointing  away  from  nominal  and  is 
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equivalent  to  v a attitude  error.  The  dynamic  component  has  a time  constant 
that  is  large  enough  (about  360  secs)  that  the  resulting  error  over  one  image 
is  essentially  constant.  Both  result  in  image  registration  errors. 

Table  5 shows  the  approximate  geometric  errors  (in  meters)  in  knowledge  of  the 
position  of  an  image  due  to  platform  errors.  These  errors  are  essentially 
constant  for  one  image  and  therefore  result  in  image  misregistration.  The  at- 
titude error  shown  here  is  the  result  of  the  low-frequency  (<2-Hz)  attitude 
errors.  Higher-frequency  attitude  errors  (jitter)  affect  the  scan  profile  and 
will  be  dealt  with  in  the  next  section.  Note  that  the  alignment  error  can  be 
extremely  large  but  postlaunch  calibration  will  reduce  this  error 
substantially. 

III.  SENSOR  ERRORS  [5,6,8,91 

In  this  section  errors  in  the  sensor  are  discussed.  Some  of  these  errors  are 
a result  cf  platform  errors  such  as  spacecraft  altitude  or  jitter.  Others  are 
errors  in  the  sensor  itself.  Specific  errors  will  be  discussed  with  respect 
to  the  TM  and  the  MSS  will  be  indicated.  As  background,  the  article  by 
Blanchard  and  Weinstein  [31  on  the  TM  design  provides  a good  review  of  the  es- 
sential design  components  of  a scanner  imaging  svstem. 

One  advantage  of  a scanning  sensor  over  nonscanning  kinds  is  that  object  plane 
scanning  can  be  used.  This  simplifies  the  performance  requirements  for  the 
rest  of  the  optical  system  by  requiring  the  telescope  to  operate  at  only  very 
small  field  angles.  Moreover,  the  same  zone  of  each  element  is  used  at  all 
scan  angles  which  eliminates  many  of  the  major  problems  of  off-axis  imaging. 
The  scanning  mechanism,  however,  is  also  a major  source  of  error  in  these  sen- 
sors. Ideally,  the  samples  from  all  the  scans  should  form  on  evenly  sampled 
grid  on  the  ground.  Deviations  from  this  idealization  must  be  measured  in 
real  time  so  that  appropriate  ground  processing  can  be  applied.  In  order  to 
understand  these  deviations,  schematics  of  the  MSS  and  TM  sensor  mechanisms 
are  shown  in  Figures  1 and  2. 

The  MSS  design  is  relatively  straightforward.  Fiber  optics  are  used  to  trans- 
mit the  focused  image  energy  to  the  detectors.  There  are  four  bands  with  six 
detectors  per  band.  Sampling  of  the  detector  outputs  is  done  only  during  a 
scan  mirror  forward  scan.  The  reverse  scan  is  used  to  bring  the  mirror  back 
to  its  initial  position  only. 

The  TM,  on  the  other  hand,  does  its  imaging  during  both  forward  and  reverse 
scans.  Due  to  the  relative  velocity  between  the  Earth  and  the  spacecraft  in 
the  in-track  direction,  the  forward  and  reverse  scans  when  projected  to  earth 
are  skewed  to  each  other.  Another  scan  mirror  (the  Scan  Line  Corrector)  that 
opposes  the  relative  in-track  motion,  is  used  to  compensate  for  this  effect. 
The  TM  has  seven  bands  and  a total  of  100  detectors.  These  detectors  are  di- 
rectly placed  on  the  focal  plane;  thus  fiber  optic  relays  with  their  attendant 
losses  are  bypassed.  Spacing  between  bands  is  naturally  larger  in  such  a de- 
sign — up  to  183  samples  maximum  (compared  to  a maximum  of  six  samples  for 
the  MSS).  Scan  profile  repeatability  and  precise  timing  is  therefore  critical 
for  accurate  band-to-band  registration. 

The  mirror  mechanism  that  does  the  scanning  is  a major  source  of  error  in 
these  sensors  — for  the  TM,  this  means  the  scan  mirror  and  the  scan  line 
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corrector  mirror.  During  active  scan  (when  imaging  is  done)  the  scan  mirror 
design  dictates  that  no  torques  act  on  it.  Under  these  conditions,  the  scan 
mirror  moves  at  a constant  angular  velocity  in  inertial  space.  This  velocity 
is  predetermined  by  design.  The  scan  line  corrector  mirror  is  also  designed 
to  scan  with  a constant  angular  velocity  opposing  the  in-tracx  velocity  of  the 
spacecraft  with  respect  to  the  Earth.  The  design  of  the  scan  line  corrector 
angular  velocity  is  based  on  the  spacecraft  altiti''  and  velocity. 

Deviations  from  design  conditions  of  the  scan  mechanism  result  in  in-track  and 
croc,s-track  efforts.  We  will  discuss  these  errors  in  terms  of  the  scan 
profiles. 

Cross-Track  Profile 


Thes  , are  the  profile  errors  in  the  scan  mirror  motion.  Again,  the  TM  is  used 
as  a base  to  describe  the  errors.  Two  kinds  of  errors  occur.  Design  condi- 
tions of  torque-free  inertial  motion  result  in  evenly  spaced  samples  on  ground 
(ignoring  the  earth  curvature  effects  and  slant  range  effects)  and  a linear 
mirror  angle  versus  time  plot  (profile).  Due  to  small  residual  torques,  how- 
ever, a nonlinear  profile  is  actually  achieved.  This  means  that  the  mirror 
motion  is  faster  or  slower  than  nominal  and  results  in  ground  sample  spacings 
that  are  uneven.  Cross-track  profile  nonlinearity  of  the  scan  line  corrector 
alsc  adds  to  the  total  cross-t,-ack  profile  linearity.  However,  the  scan  line 
corrector  nonlinearity  is  largely  in  the  in-track  direction. 

The  other  error  is  called  line  length  error,  and  refers  to  deviations  that  oc- 
cur in  total  active  scan  time  with  respect  to  the  nominal  of  60743  usee.  The 
sources  of  this  error  are  the  control  system,  spacecraft  jitter  in  the  roll 
axis,  and  interaction  of  the  Iwo,  The  sensor  scan  mirror  control  system  re- 
sponds very  well  to  jitter  caused  by  itself  but  poorly  to  external  jitter 
sources. 

The  cross-track  profile  nonlinearity  and  the  line  length  are  dynamic  error 
sources  and  must  be  measured  in  flight.  Line  length  is  easily  measured  by 
clock  counts  taken  from  start  to  end  of  scan.  The  3can  mirror  cross-track 
profile  for  the  TM  i3  modeled  as  a six-term  power  series  with  time  as  the  in- 
dependent variable.  It  has  been  shown  by  extensive  tests  [6]  that  the  varia- 
tion in  the  profile  car.  be  accurately  modeled  by  updating  the  first-order  and 
second-order  terms  of  the  power  series.  This  requires  knowledge  of  first-half 
and  sec.ind-half  scan  times  which  are  measured  by  a clock  on  the  spacecraft. 
Time  is  normalized  using  line  length  and  jitter  data. 

Table  6 shows  the  magnitude  of  along  scan  (or  cross-track)  errors. 

Along-Track  Profile 

The  ground  projected  scan  profile  (i.e.,  the  envelope  of  the  projection  of  all 
detectors  of  a band  on  ground  during  one  complete  scan)  should  ideally  be  rec- 
tangular, with  each  scan  starting  where  the  last  left  off.  The  real  ground 
projected  scan  profile  doesn't  follow  this  simple  geometry.  Gaps  between 
scans  (underlaps)  and  scan  overlaps  are  present  for  a number  of  reasons. 
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The  projected  size  of  a pixel  is  directly  related  to  the  distance  between  the 
detector  and  look  point  on  the  Earth1 s surface.  At  the  spacecraft  desigi  al- 
titude of  705.3  km,  a detector  (42,5  ^.radians)  projects  to  ground  as  a 30- 
meter  square  pixel.  The  slant  range  being  larger  than  the  nadir,  the  scan 
profile  is  wider  at  the  ends  than  it  is  in  the  center.  This  effect  is  called 
the  bow-tie  effect  and  results  in  a small  scan  overlap  at  the  scar  ends  and  an 
underlap  at  scan  center. 

Spacecraft  altitude  variations  (696  km  to  741  km)  affect  the  scan  profile  in 
two  ways.  First,  as  described  above,  it  causes  a scan  overlap/underlap.  The 
second  error  is  due  to  spacecraft  velocity  variations  as  a result  of  altitude 
deviations.  The  scan  line  corrector  mirror  rate  design  is  based  on  the  space- 
craft velocity.  When  the  latter  changes,  the  scan  line  corrector  compe**- ation 
is  no  longer  correct.  The  forward  and  reverse  scans  then  are  skewed  to  » :h 
other . 

Spacecraft  jitter  in  the  vaw  and  pitch  axis  also  shows  up  in  the  ground  pro- 
jected scan  profile.  High-frequency  jitter  causes  underlap/ overlap  to  vary 
across  the  scan.  See  Table  7 for  numerical  values  for  scan  gap  error. 

The  profiles  of  the  scan  mirror  and  scan  line  corrector  mirrors  ’n  the  in- 
track direction  is  a fixed  function  known  a priori,  and,  though  it  doe3  make 
the  ground  projected  scan  profile  deviate  from  the  rectang'lar  case,  it  is  a 
constant,  known  deviation. 

Knowledge  cf  imaging  geometry  along  with  measurement  of  the  parameters  men- 
tioned above  (which  cause  in-track  scan  nonlinearities)  allows  one  to  accur- 
ately describe  the  scan  shape  and  position  of  samples  on  the  ground.  The  next 
step  is  to  define  an  algorithm  to  perform  image  resampling  under  the  condi- 
tions, which  will  not  be  discussed  in  this  paper. 

Other  sources  of  error  in  the  sensor  are  detei  \ment  and  the  elect*  > fl- 
ic s.  These  errors  are  relatively  small  in  comparison  the  scan  nonlineari- 
ties.  They  are  summarized  in  Table  8 and  will  be  briefly  discussed.  The  ef- 
fective focal  length  (EFL)  of  the  optical  system  determines  the  oimensio^s  of 
tiie  projection  of  the  detector  cn  ground.  Because  the  image  is  scanned  across 
the  detector  arrays,  the  EFL  is  also  responsible  for  the  system  transfer  func- 
tion. Tolerances  must  be  tigh4"  if  the  real  sampling  is  to  mimic  the  design 
transfer  function  characteristics.  Values  for  the  EFL  fabrication  and  mea- 
surement tolerances  ere  shown,  as  is  deviation  of  EFL. 

The  spacing  between  detector  arrays  for  the  different  bands  determines  the 
band-tc-band  image  spacing.  Alignment  between  detector  arrays  must  be  within 
strict  tolerance  limits  or  band-to-band  registration  will  suffer. 

Vibration  of  the  detector  layout  cause  ; band-tc-band  error  lor  br.nd-to- band 
vibration  and  also  overlap/underlap  error  for  vibration  within  any  or.e  band. 
The  electronics  of  the  system  introduces  errors  too.  Detector  response  nonun- 
iformity  is  one  reason.  The  filter  response  and  timing  errors  are  other 
causes.  The  vibration  and  detector/ electronics  responses  cause  aistorti ons 
within  an  image. 

This  overview  of  spaceborne  scanner  imaging  system  errors  shows  the  sensitivi- 
ty of  image  errors  to  spacecraft  component  errors  and  also  the  interdependance 
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of  the  imaging  system  components.  As  more  sophisticated  imaging  systems  are 
developed,  with  greater  resolution  capabilities  and  stricter  accuracy  require- 
ments, the  need  to  understand  and  model  these  error  sources  becomes  more  im- 
portant [4]. 
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Table  1 . UNITS 
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Table  2 EPHEMERIS  ACCURACY  AND  VARIATION 
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SPACECRAFT  CLOCK  ACCURACY  ± 20  MILLISECONDS 


Table  3 ATTITUDE/JITTER  ERROR 

(AT  THE  TM) 
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DRIRU:  DRY  ROTOR  INERTIAL  REFERENCE  UNIT 
TDRSS:  TRACKING  AND  DATA  RELAY  SATELLITE  SYSTEM 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Table  4.  STATIC  ALIGNMENT 


• ALIGNMENT  REQUIREMENTS 

- ALIGNMENT  BETWEEN  ACS  AXIS  AND  POINTED  AXIS 
WITHIN  1.25  DEGREES  (3o) 

- POINT  THE  AVERAGED  AXES  OF  THE  MSS  AND  TM 

- ALIGNMENT  KNOWLEDGE  ACS  TO  TM  OPTICAL  AXIS 
ROLL  * .10,  PITCH  « .21,  YAW  » .21  DEGREES  (3c) 


• POSTLAUNCH  ESTIMATION  OF  SPACECRAFT  STATIC  ALIGNMENT 
WILL  BE  PERFORMED 

ACS:  ATTITUDE  CONTROL  SYSTEM 


DYNAMIC  ALIGNMENT 


• SPACECRAFT  TEMPERATURE  CHANGES  CAUSE  ALIGNMENT  CHANGES 

- EXAMPLE:  1 DEGREE  GRADIENT  ACROSS  THE  INSTRUMENT  MODUL 
CAUSES  A 12  ARC-SEC  ACS  TO  TM  ALIGNMENT  CHANGE. 

(GODDARD  ANALYSIS) 
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Table  5. 

GEOMETRIC  ERROR  IN 
SYSTEMATIC  CORRECTION  DATA 
(APPROXIMATE) 
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Table  6. 

SCAN  MIRROR  PROFILE 
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Table  7 SCAN  GAP**  ERROR 
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NOMINAL 

UNDERL4P 


Table  8.  Summary  of  Error  Sources 


Error  Source 

Magnitude 

yrad 

(90%) 

Effective  Focal  Length  (EFL) 

Band 

Across-Track  Along-Track 

EFL  Measurement  and  Fabrication 

1 to  4 

2 

2 

5 to  6 

2 

2 

5 to  1 

2 

2 _ 

EFL  Deviation 

2 yrad 

(max) 

Focal  Plane  Tolerance 

Q.4  yrad  (max) 

Detectors 

yrad 

(90%) 

Detector  Array  Alignment  Accuracy 

Band 

Across-Track  Along-Track 

1 to  4 

3 

3 

5 to  6 

31 

31 

5 to  1 

6 

6 

Band- to -Band  Vibration 

1 to  4 

1.5 

1.5 

5 to  6 

1,5 

1,5 

5 to  1 

1,5 

1.5 

One-Band  Vibration 

2.6  yrad  : 

random 

error  (90%)  in  tests. 

Detector  Response  Nonuniformity 

1 to  5 

2 

2 

5 to  6 

8 

8 

5 to  1 

2 

2 

Filter  Response  - Forward  to 

Bands  1-5 

and  7 

1.3 

IFOV  offset 

Reverse  Scan 

Band  6 

5.2 

IFOV  offset 

Filter  Response  - Bands  1-5  and 

3.0  IFOV  < 

Dff set 

7 to  Band  6 
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5.3  THEMATIC  MAPPER  PERFORMANCE* 

Jack  Engle*  Santa  Barbara  Research  Corp 

Just  a brief  overview*  if  some  of  you  aren't  familiar  with  how  the  thematic 
mapper  primarily  differs  from  MSS.  The  spatial  resolution  * s the  key  improve- 
ment where  the  TM  has  30-meter  resolution  and  the  MSS  has  80-meter  resolution. 
For  the  agricultural  users,  this  should  provide  an  abilit'  to  iccrrately  clas- 
sify 10-acre  fields  with  the  TM  versus  70-acre  fields  wi un  the  MSS  data.  As 
far  us  spectral  resolution  there  are  six  reflected  light  bands  in  the  thema- 
tic mapper.  Two  of  those  oands  are  of  basically  a new  spectral  region  out  in 
the  the  near  IRf  the  shortwave  IR  ^egion,  1.55  to  1.75  microns  and  2.08  to 
2.35  microns  as  opposed  to  MSS's  four  reflected  light  bands.  The  other  four 
thematic  mapper  reflected  light  bands  in  the  visible  portion  of  the  spectrum 
are  designated  to  enhance  the  classification  capability.  They  are  much  mc-e 
ideally  selected  from  a spectral  standpoint*  narrow  spectral  bands  more  opti- 
mally selected  to  enhance  classification  accuracy.  The  TM  also  has  better 
signal-tc-noise  ratio  performance  and  radiometric  sensitivity,  and  in  order  to 
obtain  that  we  have  had  to  increase  the  size  of  the  optics,  basically  a 
16-inch  telescope  as  opposed  to  an  9-inch  telescope  in  MSS.  We've  increased 
the  sc*.:  efficiency  through  the  use  of  bidirectional  scanning,  which  gives  us 
a scan  efficiency  of  B5%  versus  45S  with  the  mul tisp^ctral  scanner,  ana  more 
detectors  per  band,  16  versus  6.  We  also  have  greater  encoding  resolution  in 
our  multiplexer,  8-bit  resolution  versus  6 bits  for  MSS. 

One  of  the  features  that  is  of  particular  interest  is  the  scan  profile  and  the 
registration  capability.  Certainly  the  scan  profile  is  more  linear  than  was 
obtained  in  the  MSS,  and  for  a large  selection  of  the  users,  the  imagery  could 
be  used  without  resampling  and  I think  satisfy  many  of  the  needs  that  I've 
hea^d  expressed  today.  As  far  as  geometric  accuracy  or  scan  profile f a typi- 
cal Landsat  D h:S  scan  profile  exhibits  nonlinearities  on  the  order  of  five 
instantaneous  fields  of  viev.  For  the  MSS,  with  80-meter  resolution,  those 
were  on  the  order  of  500-microradian  nonlinearities  in  the  scan  profile. 

The  thematic  mapper  profile  data,  on  which,  as  I indicated,  we  are  still  doing 
some  final  refinements  in  the  processing,  is  our  me  lured  forward  scan  pro- 
file, as  shown  in  Figure  1.  You  can  see  the  peak  nonlinearity  in  the  scan  has 
a magnitude  of  about  30  microradians.  The  rms  nonlinearity  I believe  is  on 
the  order  of  10  microradians.  The  reverse  scan  profile  has  a slightly  differ- 
ent shape  (Figure  2).  It's  not  quite  as  linear  as  the  forward  scan,  but  its 
well  characterized.  The  peak  nonlinearity  in  the  reverse  scan  as  measured  in 
our  vacuum  tests  just  prior  to  delivery  was  about  60  microradians.  Each  fig- 
ure would  have  to  be  flipped  end  for  end  in  order  to  see  how  they  register  in 
object  space.  Note  also  that  they  are  both  plotted  on  a time  scale  instead  of 
an  object  space  scale. 

As  far  as  the  overlap/underlap  characteristics , Figure  3 summarizes  the  vari- 
ous contributors  to  the  overlap/' underlap  effects  within  the  system.  We  have 
chosen  to  optimize  the  scanning  parameters  at  712.5-km  altitude  and  an  average 
40°  north  latitude  where  most  of  the  scenes  of  interest  appear  to  be  located 


•Edited  oral  presentation. 
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throughout  the  world.  As  the  scanning  parameters  were  optimized  for  that  al- 
titude and  latitude,  the  resultant  underlap  and  overlap  of  about  3. ft  and  -3. ft 
microradians  occurs  (Figure  ft). 

The  bow-tie  effect  (Figure  ft)  is  basically  due  to  the  path  length  over  the 
scan  angle.  From  one  end  of  the  scan  to  the  other  this  contributes  an  overlap 
effect  of  about  6,5  microradians  at  the  end  of  scan.  Scan  mirror  performance 
has  these  contributions.  Basically,  within  the  prime  focal  plane,  we  have  a 
maximum  ever/ underlap  cf  about  7.3  microradians,  and  with  the  bow-tie  effect 
included  we  have  a maximum  overlap  of  about  11.1.  For  the  cooled  focal  plane, 
we  have  7.9  with  a maximum  overlap  of  10.5.  (Xir  requirement  is  8.5  microra- 
dians neglecting  the  bow-tie  effect  so  we're  fairly  well  within  our  require- 
ments. Basically,  the  altitude  variations  globally  sort  of  wash  out  or  cer- 
tainly dominate  the  overlap/ underlap  performance  on  a global  scale. 

As  far  as  band-to-band  registration,  we  chose  the  band-to-band  registration 
between  bands  5 and  b^  1 1 which  are  the  furthest  separated  bands  within  the 
thematic  mapper  (Figures  5 and  6).  The  nominal  band  spacing  is  1ft6  instan- 
taneous fields  of  view  and  the  dynamic  registration  measured  at  30  points  in 
the  scan  profile  is  as  plotted  with  a typical,  an  average  registration  of 
about  1ft5.95.  Our  requirement  is  that  the  prime  and  cool  focal  planes  be  reg- 
istered to  within  .3  of  an  instantaneous  field  of  view  and  about  the  nominal 
band  separation.  So  we  are  well  within  our  requirement  on  a dynamic  registra- 
tion basis  between  tne  pr  ime  and  cooled  focal  planes.  All  the  other  spectral 
bands,  with  respect  to  band  1 are  more  closely  registered. 
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Figure  1.  Forward  Scan  Profile 
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Figure  3.  Overlap/Underlap  (3. 2, 7. 2)  (mi  ere  radians) 
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Figure  5.  Dynamic  Band-to-Band  Registration  (Along  Scan) 
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Figure  6.  Dynamic  Band-to-Band  Registration  (Along  Scan) 


\i  TJ82'  28715 

5.4  SCANNER  IMAGING  SYSTEMS,  AIRCRAFT 
Stephen  G.  Ungar 

NASA/Goddard  Institute  for  Space  Studies 

With  the  advent  of  advanced  satellite-borne  scanner  systems, 
the  geometric  and  radiometric  correction  of  aircraft  scanner  data 
has  become  increasingly  important.  These  corrections  are  needed  to 
reliably  simulate  observations  obtained  by  such  systems  for 
purposes  of  evaluation.  This  paper  reviews  the  causes  and  effects 
of  distortion  in  aircraft  scanner  data  and  discusses  an  approach  to 
reduce  distortions  by  modelling  the  effect  of  aircraft  motion  on 
the  scanner  scene. 

Causes  of  Distortion 

Both  the  location  of  an  observation  (or  pixel)  on  the  ground 
and  the  target  area  (footprint)  contained  within  the  instantaneous 
field  of  view  (IFOV)  of  the  sensor  system  are  governed  by  the 
following  three  factors:  aircraft  position;  aircraft  attitude;  and 

sensor  system  can  angle.  Terrain  relief  may  interact  with 
a i rcra f t/scanner  geometry  to  further  complicate  determination  of 
pixel  position  and  footprint  in  planar  coordinates.  For  purposes 
of  ♦his  discussion,  we  shall  address  only  cases  in  which  the 
te  rain  effects  are  negligible. 

During  the  acquisition  of  a single  scan  line,  the  scan  pattern 
on  the  ground  is  largely  a function  of  the  scan  geometry  convoluted 
with  the  attitude  of  the  aircraft.  It  is  convenient  to 
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characterize  an  aircraft's  attitude  (orientation)  in  terms  of  a 
fusilage  axis  and  a wing  axis.  The  fusilage  axis  passes  from  tail 
to  nose  through  the  aircraft's  center  of  gravity.  The  wing  axis 
passes  through  the  center  of  gravity  parallel  to  the  wing  surface. 

The  orientation  of  the  fusilage  axis  is  expressed  in  spherical 
polar  coordinates  as  follows:  the  angle  of  rotation  east  of  north 

about  a vertical  axis  (clockwise  rotation  looking  down  at  aircraft) 
is  called  heading  (4>)  ; the  angle  of  the  nose  above  the  horizontal 
is  called  the  pitch  (0)  . An  additional  angle,  roll  ;p)  , is 
required  to  specify  the  final  orientation  of  the  wing  axis  and  is 
measured  by  the  degree  of  clockwise  rotation  of  the  aircraft  about 
the  fusilage  axis  looking  towards  the  nose.  Since  the  aircraft 
scanner  systems  treated  here  rotate  in  a plane  perpendicular  to  the 
fusilage  axis,  roll  can  be  combined  with  the  scanner  orientation  to 
determine  the  effective  scan  angle.  The  scan  angle  (v)  is  the  look 
angle  of  the  sensor  measured  clockwise  from  a direction  mutually 
perpendicular  to  the  fusilage  and  wing  axis  (i.e.,  the  nadir 
direction  for  an  aircraft  in  level  flight).  Therefore,  the 
effective  scan  angle  may  be  expressed  as  (ve  = p +v). 

Given  the  altitude  of  the  aircraft  and  the  coordinates  of 
the  nadir  point  below  the  aircraft,  the  position  of  the  instantaneous 
viewpoint  on  the  ground  can  now  be  located  in  terms  of  the  atti- 
tude parameters.  Table  1 presents  the  detailed  formulas  required 
for  making  this  calculation.  "h"  is  the  altitude  of  the  aircraft 
above  the  ground,  XQ  and  Yq  are  the  coordinates  at  aircraft  nadir. 
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We  have  selected  a coordinate  system  in  which  the  positive  x- 
direction  is  east  and  the  positive  y-direction  is  south  in  order 
to  conform  to  conventions  found  in  most  image  processing  systems. 

Impact  of  Aircraft  Motion 

In  principle,  both  the  attitude  and  position  of  the  aircraft 
changes  during  the  acquisition  of  a scan  line.  However,  contem- 
porary scanner  systems  actively  gather  image  data  only  during  a 
time  interval  of  approximately  12  to  28  percent  of  the  scan  period. 
Typical  scan  periods  range  from  0.05  to  0.1  seconds.  Therefore, 
in  practice,  changes  in  aircraft  attitude  may  be  considered 
negligible  during  the  active  portion  of  the  scan.  The  forward 
motion  of  the  aircraft  will  introduce  skew  in  the  scan  line 
pattern  which  amounts  to  approximately  one-tenth  pixel  displacement 
at  the  end  of  the  scan  line  for  contemporary  systems.  This  corres- 
ponds to  an  angle  of  about  0.01  degrees.  A viable  geometric 

correction  scheme  need  only  update  the  aircraft's  position  once 
per  scan  line,  specifying  the  aircraft  coordinates  at  ^ = 0. 

Rectification  of  Scanner  Data 

Table  1 outlines  a method  for  rectifying  aircraft  scanner 
observations  in  cases  where  reliable  navigational  data  is  available. 
As  previously  discussed,  the  first  half  of  the  table  relates  the 
planar  coordinates  of  the  pixel  to  the  navigational  parameters  for 
a given  nadir  location  (Xo,YQ) . The  remainder  of  Table  1 describes 
an  integration  scheme  for  updating  the  nadir  position  during  the 
course  of  the  flight.  The  scheme  is  valid  for  situations  in  which 
navigational  data  is  available  at  time  intervals  wnich  are  com- 
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parable  or  less  than  the  scan  period.  The  values  of  all  naviga- 
tional parameters  including  aircraft  velocity  may  be  estimated 
at  the  center  of  each  scan  = 0)  by  cubic  interpolation  as 
indicated  in  Step  2.  Finally,  the  aircraft,  nadir  displacement 
in  both  the  x and  y-directions  between  scans  may  be  calculated  as 
indicated  in  Step  3.  For  roll-compensated  systems,  the  scan  mirror 
moves  with  a constant  "inertial"  velocity  and  At  represents  the 
period  of  (ij;  = p + \p) . Under  these  circumstances,  the  solutions 
to  the  equations  in  Table  1 are  equivalent  to  assuming  p = 0 at 
all  time1-  and  dropping  that  term  out  of  the  analysis. 

Simulated  Flight 

The  impact  of  variations  in  flight  parameters  on  aircraft 
scanner  imagery  can  best  be  illustrated  by  simulating  a flight 
over  a geometrically  regular  pattern  and  varying  the  flight  para- 
meters in  a controlled  way.  The  simulated  scanner  system  selected 
for  this  study  is  patterned  after  NASA's  NS001  scanner  systm 
flown  onboard  a C130  aircraft.  Nominal  flight  and  scanner  para- 
meters are  given  in  Table  2.  Simulated  flights  are  conducted  over 
a checkerboard  pattern  consisting  of  half  mile  square  sections 
(approximately  800  meters  x 800  meters).  Figures  1(a-L)  show 
the  results  of  such  flights  with  flight  parameters  deviating  from 
the  nominal  values  as  specified.  The  left  portion  of  each 
figure  displays  the  scan  system  pattern  projected  on  the  ground 
as  follows:  the  "footprint”  for  each  observation  along  every 

90th  scan  line  is  represented  as  a plotting  point;  in  addition, 
the  footprints  of  observations  on  every  scan  line  are  plotted  at 
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10  degree  intervals  (from  -50  to  +50  degrees).  The  scanner 
"image",  consisting  of  radiometric  values  of  the  simulated 
checkerboard  terrain,  is  displayed  in  scanner  coordinates  (pixel 
position,  scan  line)  to  the  right  of  its  correu,.  ading  ground 
pattern. 

For  agricultural  applications,  it  is  instructive  to  draw 
an  analogy  between  the  checkerboard  squares  and  field  boundaries. 
Figure  1(A)  represents  an  ideal  case  of  the  aircraft  fiying  from 
north  to  south,  parallel  to  field  boundaries,  with  all  parameters 
fixed  at  constant  altitude.  The  foreshortening  of  fields  at 
the  edges  of  the  flightline  is  due  to  the  oblique  look  .ngle  at 
the  ends  of  the  scan.  In  Figure  1(B),  we  introduce  a drift 
(v  component)  in  the  aircraft  motion  while  keeping  the  heading 
(orientation)  of  the  aircraft  north-south  (in  positive  y direction) . 
Motion  of  this  sort  occurs  in  situations  where  aircraft  flying 
at  fixed  headings  are  subject  to  substantial  constant  cross  winds. 
The  drift  component  introduces  a skew  in  north-south  field 
boundaries  caused  by  the  shift  in  x value  of  the  nadir  coordinates 
along  the  aircraft  ground  track.  Figure  1(C)  illustrates  a 
flight  with  heading  20  degrees  west  of  south  as  opposed  to  due 
south.  This  produces  a flight  pattern  identical  to  that  of 
Figure  1(A),  but  rotated  with  respect  to  field  boundaries.  The 
accompanying  image  shows  the  typical  S-shaped  distortion  in  the 
field  boundaries  that  is  so  characteristic  of  linear  features 
in  aircraft  scanner  data.  This  occurs  because  the  road  sections 
are  no  longer  aligned  with  the  scan  direction,  although  the 
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distortion  is  still  in  the  scan  direction.  Figure  1(D)  portrays 
the  impact  of  the  aircraft  flying  in  a banked  position.  The  scan 
center  ground  track  is  displaced  20  degrees  to  the  west  of  the 
aircraft  nadir  ground  track.  Many  aircraft  scanner  systems, 
including  the  NS001,  are  "roll-compensated"  to  maintain  the  scan 
center  along  the  aircraft  nadir  ground  track. 

Many  of  the  distortions  in  scanner  imagery  result  largely 
from  variations  in  orientation  of  the  aircraft  during  the  flight. 

For  example,  a change  in  pitch  results  largely  in  a fixed  displace- 
ment along  the  ground  track  such  that  the  aircraft  is  looking 
somewhat  ahead  of  where  it  normally  would.  In  addition,  each  scan 
covers  a somewhat  wider  swath  on  tb-  ground.  However,  variations 
in  pitch  results  in  distortions  such  as  those  displayed  in  Figures 
1(E)  and  1(H).  In  Figure  1(E),  the  pitch  varies  linearly  from  0 
degrees  at  the  start  of  the  flight  segment  to  20  degrees  at  the 
end.  The  most  apparent  effect  is  the  widening  coverage  in  the  sea" 
direction  as  the  flight  progresses.  In  addition,  the  changing  pitch 
angle  contributes  to  increasing  the  effective  ground  velocity 
beyond  v . Thus  the  distance  between  scan  ljnes  is  increased, 
resulting  in  a squeezing  of  fields  in  the  y-direction  on  the  scanner 
image.  Figures  1(F)  and  1(G)  display  the  impact  of  similar  type 
variations  in  heading  and  drift,  and  in  roll.  In  particular, 

Figure  1(F)  shows  the  combined  effect  of  a 10  degree  linear  varia- 
tion in  heading  and  a 10  degree  linear  variation  in  aircraft 
tracking  angle  due  to  drift. 
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In  general,  aircraft  motions  are  more  complex  than  can  be 
adequately  represented  by  a linear  variation  over  the  course  of  the 
flight.  Typically,  motion  will  be  oscillatory  in  nature,  since  it 
is  generally  desirable  to  correct  departures  from  nominal  flight 
parameters.  Figures  1(H)  through  1(L)  portray  the  effects  of 
sinuso-dal  variations  in  selected  flight  parameters.  In  Figure 
1(H)  the  aircraft  nose  pitches  up  to  a maximum  angle  of  20  degrees 
and  then  is  brought  back  down,  passing  through  the  horizontal,  to  a 
negative  pitch  angle  of  20  degrees  and  finally  back  to  horizontal 
flight  by  the  end  of  the  flight  segment.  The  scan  pattern  near  the 
center  of  the  flight  segment  indicates  that,  although  the  aircraft 
is  moving  forward  the  center  line  of  the  scanner  moves  backward 
because  of  the  variation  in  pitch  resulting  in  a prolonged  viewing 
period  for  areas  on  the  ground  at  this  point  in  the  flight.  This 
is  clearly  seen  by  field  distortions  in  the  accompanying  image. 
Figure  1(1  shows  the  result  of  similar  variation  in  heading.  The 
turning  of  the  aircraft  can  cause  the  edges  of  the  scan  line  to 
move  backward  with  respect  to  forward  motion  of  the  aircraft  during 
portions  of  the  flight  segment.  This  can  result  in  a rather 
distorted  image  since  the  same  area  on  the  ground  may  be  viewed 
more  than  once  during  the  flight  segment.  In  effect,  at  the  time 
the  aircraft  is  experiencing  its  maximum  change  in  heading,  it  may 
be  considered  as  moving  perpendicular  to  a radius  of  curvature 
lying  along  the  scan  dir^tion.  Ground  a.  .as  near  the  center  of 
curvature  will  be  obse  c repeatedly  while  the  edge  of  the  scan, 
beyond  the  radius  of  the  curvature,  will  be  covered  in  reverse 


144 


direction  (from  south  to  north)  during  that  portion  of  the  flight 
segment.  As  the  variation  in  heading  is  reduced  the  normal  forward 
motion  of  the  aircraft  will  force  the  scan  coverage  at  the  edge  to 
once  again  proceed  from  north  to  south  doubling  back  over  the  area 
covered.  In  fact,  some  areas  near  the  edge  of  the  scan  line  may  be 
observed  as  many  as  three  times  during  the  course  of  the  flight 
segment.  This  creates  a racher  significant  problem  in  attempting 
to  recapture  or  correct  for  radiometric  values,  even  in  the 
situations  where  the  scanner  geometry  is  well-known. 

As  can  be  seen  in  Figure  1(J),  variations  in  the  aircraft 
tracking  angle  equal  to  those  occurring  in  Figure  1(1)  can  be 
obtained  by  varying  the  drift  angle.  The  scan  center  ground  track 
in  Figure  1(1)  is  identical  to  that  of  1(J).  However,  in  1(J) 
the  orientation  of  the  aircraft  is  maintained  constant  and  the 
scan  pattern  is  consequently  much  simpler,  with  no  crossing  of 
scan  lines.  Figure  1(K)  displays  a situation  in  which  the  heading 
and  drift  are  varying  simultaneously  in  a manner  such  that  the 
trackin'  angle  variation  is  identical  to  that  of  Figures  1(1) 
anf  1(J).  Once  aga^n,  it  is  difficult  tc  establish  a one-to-one 
mapping  between  actual  ground  coordinate  radiometric  values  and 
the  values  which  appear  in  the  scanner  imago.  Figure  1(L;  portrays 
a sinusoidal  variation  in  roll  angle,  beginning  from  level  flight, 
banking  to  20  degrees  below  the  horizon  in  the  west,  and  returing 
to  level  flight.  In  this  instance,  the  flight  segment  is  flown 
in  the  time  equal  to  the  half  period  of  the  sinusoidal  variation. 
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In  summary,  if  sufficient  navigational  information  xs 
available,  aircraft  scanner  coordinates  may  be  related  very 
precisely  to  planimetric  ground  coordinates  using  the  approach 
outlined  in  Table  1.  However,  the  potential  for  a multi-value 
remapping  transformer ion  (i.e.,  scan  lines  crossing  each  other', 
adds  an  inherent  uncertainty,  to  any  radiometric  resampling  scheme, 
which  is  dependent  on  the  precise  geometry  of  the  scan  and  ground 
pattern. 
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TABLE  1 


AIRCRAFT  SCANNER  GROUND  PATTERN  EQUATIONS 

X*X0*h  tonfl  sin$-h(ton(^*f;/cos0)cos$ 

Y*Yc-h  Ion 8 cos$*h(ton(^f)/cos0)sin  $ 


Xo(l‘At)*Xo(t)4/w  sin($‘8)dt 

« 

X>(t*At)*Y0  (t)  - J i'cos($*8)dt 
1 

where:  X0 . X,1  nadir  coordinates 
At * scan  period 
0s  pitch 
heading 
8 =drift 


roll 

scan  angle 
h*  altitude 
vs  ground  speed 


UPDATING  X.,Xr  WITH  NAVIGATION  DATA  (NERDAS) 

(1)  Find  Martit  obstntttioii  Kmis  from  NERDAS 

ti— t * t^  where.  i*INT  ((t-tj/f+l) 

f 'frequency  of  observation 

(2)  Obtain  veltni  for  aach  scan  by  cubic  interpolation 

LVil  - c Go  t 
>•0 

where-.  1 represents  (S.^.S.^.h.  or  v] 
using  NE.RDAS  volues  for  Z(tJ  i-l*k»i+2 
sc^we  for  a,  n'O....  4 

(3)  Caiculato  nadir  displacement  between  scans  assuming 

r’Zdt'S  9-  ((,M/fr-r] 

i e»l  l 1 

where  Z represents  v sin (^*8) or  -v  cos {$*8) 
and  o„  is  determined  by  technique  used  in  step  (2) 
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Ken  J.  Ando,  NASA  Headquarters 

MLA  is  the  abbreviation  for  "Multispectral  Linear  Array.”  Within  NASA,  MLA 
has  evolved  to  become  the  generic  term  for  the  sensor  concept  and  technology 
associated  with  solid-state  electronically  scanned  linear  arrays  operating  in 
the  pushbroom  mode  for  resource  observations.  The  overall  program  objective 
is  to  develop  the  enabling  technology  and  instrument/mission  definition  phase 
for  the  application  of  advanced  solid-state  sensors  for  future  experimental 
remote  sensing  missions.  The  approach  being  taken  is  to  develop  complementary 
multiyear  efforts  at  GSFC  and  JPL.  GSFC  will  concentrate  upon  focal  plane  de- 
velopment, instrument  concept/design  development,  mission  studies,  and  service 
requirements;  JPL  is  concentrating  on  development  of  an  imaging  spectrometer 
technology  and  a Shuttle  sortie  mission  definition. 

There  i3  a heavy  emphasis  on  technology.  The  technologies  that  we  are  devel- 
oping are  the  shortwave  infrared  focal  plane  technology,  primarily  mercury- 
cadmium-teluride,  platinum-silicide,  visible  chips,  the  optics,  passive  radia- 
tors — all  the  critical  technology  acquired  for  the  implementation  of  an  MLA 
system.  We  are  also  developing  instrument  concepts  and  we  are  doing  this 
through  a number  of  Phase  A studies.  In  addition,  we  have  support  activities. 
Primarily  we  are  trying  to  define  what  the  requirements  are  from  a science 
standpoint,  and  what  the  user  requirements  are,  and  how  can  we  best  utilize 
this  technology.  We  are  in  the  process  of  forming  a science  wo-  ng  group. 
And  finally,  we  are  looking  into  various  concepts  and  scenarios  tor  missions 
for  validation  of  the  technology. 

I want  to  mention  the  fact  that  besides  the  MLA  activity  there  are  other  com- 
plementary technology  efforts  within  NASA.  There  is  the  information  adaptive 
system  effort  which  is  being  funded  by  OAST.  This  is  an  effort  to  develop  and 
demonstrate  a breadboard  for  on-board  signal  processing  MLA-type  data.  Spe- 
cifically, this  breadboard  process  will  correct  all  the  MLA  data  at  the  80- 
to  90-megabyte  range,  and,  in  addition,  generate  all  the  geometry  correction 
factors  such  that  it  can  be  resampled  on  the  ground.  The  input  will  be  the 
ephemeris  information,  the  attitude  control  information  and  the  thermal  data 
from  which  the  resampling  coefficients  will  be  calculated.  There  are  two 
other  activities,  one  called  TIPA  (Thermal  Infrared  Ray) — an  effort  which  has 
been  under  way  for  about  two  years  to  develop  an  8-  to  12,000-micron  element 
linear  array.  Finally  there  is  another  activity  — TIMS  (Thermal  Infrared 
Multispectral  Scanner):  this  is  an  effort  to  develop  a 6-channel  imaging  spec- 
trometer radiometer  for  aircraft  utilization.  I might  mention  that  the  scan- 
ner will  be  delivered  to  JPL  for  calibration,  then  in  the  June-July  time  frame 
it  will  be  flown  on  the  Lear  23  Jet  out  of  NSTL. 

One  of  the  areas  th»t  we're  looking  at  is  the  possibility  of  some  sort  ot  a 
Shuttle  experiment.  Originally,  our  major  interest  was  in  some  soi  t of  a 
free-flyer;  however,  with  the  budget  uncertainties  we  felt  that  a Shuttle-type 
mission  might  be  a viable  and  perhaps  a more  realistic  alternative  as  a pre- 
cursor for  a full-up  experimental  mission  utilizing  a fre^-flyer.  What  I have 
summarized  here  are  some  of  the  objectives,  technology  validation  objectives. 
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and  some  research  objectives.  It  turns  out  that  there  are  some  problems  util- 
izing the  Shuttle  for  this  type  of  research.  Primarily  the  Shuttle  does  not 
have  a very  adequate  pointing  system.  The  way  we  think  we  can  circumvent  that 
is  to  utilize  some  ox"  the  pointing  modules  which  are  currently  under  develop- 
ment with  NASA.  One  of  them  is  the  IPS,  and  I understand  there  is  another 
pointing  module  which  is  being  developed  by  Langley.  By  tilting  the  Shuttle 
about  45°  and  looking  simultaneously  at  fhe  stars,  we  think  we  can  both  track 
and  get  ACS  information  in  addition  to  imaging  on  the  ground. 

Figure  1 provides  a comparison  between  MLA  and  other  Earth  observation  imaging 
systems.  There  are  three  types  of  techniques  to  generate  imagery.  There  is 
the  conventional  scanner  — the  mechanical  scanner  — which  scans  back  and 
forth  across  the  ground  with  the  spacecraft  providing  the  motion  and  the  scan 
in  the  in-track  direction.  The  next  level  of  scanner  beyond  this,  which  is 
strictly  mechanical,  is  the  MLA  approach  which  is  basically  a linear  array 
which  provides  electronic  scan  in  the  cross-track  direction  and  the  orbital 
motion  provides  the  scan  in  the  in-track  direction.  The  key  here  is  the  fact 
that  the  pushbroom-type  scanner  provides  simultaneous  imaging  in  the  cross- 
track direction  — it  maintains  perspective  in  one  direction  at  least.  Tf  you 
go  to  a conventional  framing  camera  like  a 35-mm  camera,  the  perspective  is 
imaged  silmultaneously  in  both  directions  — the  conventional  framer.  Again, 
NASA  examples  are  the  return  beam  videcon  and  the  large  format  camera  — which 
is  a film  camera.  What  I want  to  summarize  here  are  some  of  the  pushbroom- 
type  scanners  which  have  been  proposed  and  one  which  is  actually  in  the  hard- 
ware stage.  The  imaging  spectrometer  (Figure  2)  is  an  approach  which  JPL  is 
developing  and  basically  is  an  approach  wherein  a slit,  which  corresponds  to 
one  line  on  the  ground,  is  simultaneously  imaged  in  a number  of  spectral 
bands.  The  slit  is  dispersed  by  the  defraction  grading  and  hen  reimaged  onto 
the  area  ray.  The  advantage  is  that  you  have  inherent  registrations  because 
of  the  fact  that  you  are  imaging  only  the  slit  and  all  the  colors  simultane- 
ously. The  other  advantage  is  the  fact  that  by  programming  the  array  you  can 
arbitrarily  change  both  the  spectral  path  and  the  center  frequencies. 

As  far  as  the  potential  advantages  of  the  pus’nbroom  mode  of  imaging  with  the 
MLA,  one  of  the  limitations  of  the  mechanical  scanner  is  the  question  of  scan- 
ner linearity.  With  an  electronic  scanner  l_ke  the  MLA,  for  all  intents  and 
purposes,  there  is  no  linearity  because  of  the  fact  that  you  are  electronical- 
ly scanning  as  opposed  to  mechanically  scanning.  One  of  the  advantages  is 
that  you  simultaneously  image  a line — all  the  pixels  in  one  line — so  that 
there  is  less  than  a jitter  problem — because  you  have  literally  frozen  the 
line  in  time  and  space.  There  is  no  high-frequency  jitter  component  variation 
from  pixel  to  pix because  you  donft  scan  across  the  line,  you  simultaneously 
image  it.  The  other  advantage  is  the  fixed  geometry,  and  again  that  provides 
the  true  perspective  in  cross-  ack  direction  and  that  potentially  will  reduce 
the  geometric  correction  requirements  and  resampling  requirements  simply  be- 
cause of  the  fact  that  the  detector  geometry  was  fixed.  The  other  attribute 
is  the  fact  that  since  the  scan  is  electronic,  you  can  change  them  and  program 
them;  for  example,  if  you  have  orbit  anomally,  you  can  presumably  change  the 
scan  rates  dynamically  such  that  you  don't  have  the  overlap-underlap  problem. 
Finally,  inherent  band-to-band  registration  is  possible.  One  of  the  reasons 
why  we  are  insisting  on  obtaining  band-to-band  registration  and  one  cf  the  re- 
quirements of  the  definition  study  is  that  band-tc-band  registration  be  less 
than  1/10  of  a pixel.  This  requirement  is  made  because,  for  example,  if  you 
have  a 15-meter  pixel  and  a misregistration  of  1/10  of  a pixel,  then  the  best 
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you  can  do  as  far  as  the  error  in  the  ratios  is  of  the  order  of  21.  We  are 
currently  involved  in  an  instrument  definition  study,  and  we  have  four  con- 
tractors studying  alternative  instrument  configurations.  One  of  the  things 
that's  come  out  of  the  studies  is  the  fact  that  it's  going  to  be  very,  very 
difficult  to  mechanically  register  each  of  che  bands  to  less  thrn  1/10  of  an 
IFOV. 

What  the  Table  1 chart  does  is  compare  the  results  of  mounting  a Fairchild 
Loreors  and  the  MLA  requirements.  As  you  can  see,  it  looks  like  it's  possible 
to  get  to  1/10  of  an  IFOV,  but  this  is  the  current  state  of  the  art  in  terms 
of  the  physical  location  and  mounting  of  chips  to  form  a contiguous  array. 

I just  want  to  quickly  touch  on  two  considerations  as  far  as  misregistration 
is  concerned.  One  is  the  impact  of  the  Earth's  rotation  (see  Figure  3)*  If 
you  have  a displacement  of  the  array  in  the  focal  plane  — let's  say  you  have 
a six-linear  array  focal  plant  consisting  of  six-linear  arrays  with  integrated 
filters,  the  physical  displacement  between  band  one  and  band  six  had  to  be 
less  than  20  IFOVs.  The  impact  of  the  rotation  or  the  Earth  is  shown  in 
Figure  3.  There  are  two  ways  to  compensate  for  the  misr  gistration  and  that 
is  to  introduce  a yaw  and  a pitch  in  the  direction  opposite  the  westerly  rota- 
tion of  the  Earth.  The  other  is  to  simply  change  the  heading,  and  reduce  the 
velocity  vector  associated  with  the  rotation  of  the  Earth.  Another  considera- 
tion — and  this  one  is  equally  applicable  to  scanners  and  to  pushbroom  arrays 
— is  che  effect  of  off  nadir  viewing  and  the  geometric  con.’i'J  eration  (Figure 
4).  As  you  view  off  nadir,  obviously  what  happens  is  that  you  get  panorama 
effect.  You  get  geometric  distortion,  but  in  addition,  there's  a resolution 
and  a scale  change.  I might  add  that  the  field  of  views  currently  being  con- 
sidered for  the  MLA  is  +7-1/2  to  15  degrees.  It  turns  out  that  the  pushbroom 
array,  because  of  the  fact  that  it  simultaneously  images,  has  an  advantage. 
By  maintaining  perspective,  it  turns  out  that  there's  a slight  geometric  dis- 
tortion advantage  to  the  pushbroom  over  the  scanner.  But  as  you  can  see  if 
you  point  off  nadir,  there's  a significant  change  in  the  perspective  which  we 
call  the  panorama  effect.  That  impacts  the  problem  associated  with  absolute 
geolocation  and  misregistration  because  any  attitude  change  will  result  in  a 
considerably  larger  uncertainty  in  term?  of  registration  and  geolocation  off 
nadir  than  on  nadir.  So  to  summarize  some  of  the  issues  associated  with  off 
nadir  viewing,  any  system  we're  going  to  consider  in  the  future  will  have  the 
capability  to  point  off  nadir.  The  reason  we'd  like  to  go  to  off-nadir  point- 
ing is  to  increase  the  temporal  visitation.  For  example,  with  SPOT,  their 
26-day  overpass  cycle  is  reduced  to  one  to  five  days  by  a +26°  off-nadir  view- 
ing capability.  From  the  research  standpoint,  there  are  additional  desirable 
features  of  off-nadir  pointing.  These  include  the  ability  to  investigate  at- 
mospheric effects,  adjacency  effects,  and  calibrate  the  atmosphere.  A key  is- 
sue for  the  conference  to  be  concerned  with  as  far  as  off-nadir  pointing  is 
the  possibility  of  registering  a nadir  scene  with  an  off-nadir  scene,  given 
the  geometric  distortions  and  the  other  problems  associated  with  off-nadir 
viewing. 


155 


IMAGE  SCANNED 
ELECTRONICALLY 


156 


ha&a  ho  irfinii  m 
11TM1 


v-  p ’ r v* 

wr  t'bc*  Qu.Ai.jr/ 


157 


Figure  2.  Im^, ,ng  Spectrometer 


TahlP  1.  COMPARISON  OF  LOREARS  FOCAL  PLANE  MOUNTING 
RESULTS  WITH  MLA  REQUIREMENTS 
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• INCREASED  ATTITUDE,  EPHEMERIS  SENSITIVITY 

• RADIOMETRIC  CHANGE 
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I.  INTRODUCTION 


Synthetic  aperture  radar  (SAR)  [i,2]  is  a side-looking  sensor  capable  of 
very  fine  along-track  resolution.  This  characteristic,  in  addition  to  its 
all-weather  monitoring  capability,  makes  it  an  attractive  instrument  for 
generating  space  imagery.  A SAR  typically  operates  in  a spectral  region 
(1-10  GHz)  that  complements  most  optical  scanners  (LANDSAT).  In  this  region, 
the  subsurface  sensing  depth  is  much  greater  and  the  reflectance  properties 
of  imaged  terrain  objects  are  different  [3].  A SAR  will  therefore  collect  a 
complementary  set  of  "terrain  signatures"  that  when  registered  with  other 
spectral  data  can  greatly  facilitate  the  interpretation  of  remotely  sensed 
imagery.  But  before  multisensor  data  can  be  properly  registered,  the  various 
types  of  distortion  inherent  in  SAR  imagery  must  be  quantitatively  analyzed. 
This  requires  an  understanding  of  the  properties  of  the  sensor  as  well  as  the 
data  processing  system  used  in  the  image  formation. 

The  production  of  quality  imagery  from  spaceborne  SAR  data  requires 
extensive  processing  of  the  raw  echo  data*  This  procedure  is  more  complex 
than  previously  used  for  aircraft  SAR  imagery  due  to  the  large  increase  in 
sensor  altitude.  The  correlation  procedure  must  compensate  not  only  for 
undesirable  spacec  ift  motion,  but  also  for  target  motion  resulting  from 
Earth  curvature  and  rotation  [4,5].  To  simplify  this  procedure, 
approximat ions  are  often  made  that  can  result  in  both  geometric  and 
radiometric  distortion  in  the  image  product.  Furthermore,  the  viewing 
geometry  of  the  SAR  and  the  charac terist ics  of  the  data  collection  system 
will  also  introduce  distortion  into  the  imagery.  Precise  registration  of  SAR 
imagery  with  ether  types  of  remotely  sensed  imagery  requires  the 
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identification  of  these  distortions  and  the  development  of  post-processing 
techniques  to  rectify  them.  Furthermore,  considering  the  large  quantity  of 
data,  it  is  desirable  that  these  postprocessing  techniques  be  automated  and 
designed  to  interface  directly  with  the  image  processor  to  generate  a 
geometrically  and  radiometricaily  correct  product  without  supervision  or 
operator  interaction. 

This  paper  will  summarize  what  is  currently  known  about  these 
distortions  and  describe  the  development  to  date  of  unsupervised 
post-processing  rectification  techniques.  The  geometric  distortion  can  be 
divided  into  two  categories.  The  first  catagory  consists  of  distortion 
derived  from  the  radar  viewing  geometry.  This  includes  such  effects  as 
ground  range  nonlinearities,  radac  foreshortening  and  radar  layover.  The 
second  category  consists  of  distortions  introduced  during  the  data 
processing.  These  distortions  result  from  approximations  made  during  the 
correlation  such  as  in  estimation  of  the  target  phase  history,  or 
compensation  for  the  earth  rotation.  The  processor  induced  distortions  will 
obviously  depend  on  the  specific  correlation  algorithm  used  for  image 
formation.  This  paper  generally  addresses  the  effects  on  the  image  4 roduct 
resulting  from  assumptions  during  the  processing  and  it  specifically 
considers  distortions  inherent  in  digital  imagery  produced  by  the  digital 
image  processor  at  JPL  16]. 
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II.  SAR  REVIEW 


This  section  is  intended  as  a brief  tutorial  on  SAR  system 
characteristics  and  processing  techniques*  Basic  system  parameters  are 
introduced  that  are  relevant  to  understanding  the  sensor  and  processor 
induced  distortion  to  be  discussed  in  subsequent  sections.  Interested 
readers  will  find  an  excellent  treatment  of  various  characteristics  of  SAR  in 
a recently  published  collection  of  paper** 

2,1  SAR  Sensor  Characteristics 

The  viewing  geometry  for  a SAR  in  the  imaging  mode  is  illustrated  in 
Figure  1-  The  sensor  moves  along  a predetermined  orbit  track  radiating 
energy  in  the  form  of  pulses  and  receiving  the  backscattered  signal*  This 
data  is  either  recorded  on  film  for  later  optical  processing  or  is 
transmitted  on  a downiick  to  a tracking  station  where  it  is  digitized  and 
recorded  on  high-density  tape  for  digital  processing.  The  antenna  pointing 
direction  is  normal  to  the  flight  path  and  its  orientation  with  respect  to 
the  spacecraft  is  normally  fixed.  Two  important  system  parameters  are  the 
antenna  look  angle  0 , defined  as  the  angle  the  antenna  beam  with  respect 
to  nadir  direct  ion,  and  the  slant  range  R,  the  distance  from  the  sensor  to  the 
imaged  target  area.  The  radar  antenna  range  beamwidth  and  the 
spacecraft  altitude  U,  determine  the  cross-track  dimension  of  the  radar 
footprint. 

The  radar  transmitter  is  typically  designed  to  operate  in  a frequency 
region  between  L-band  and  X-band , thus  permitting  cloud  and  fog  penetration. 
The  pulse  repetition  frequency  (FRF)  of  the  radar  and  the  spa  .raft  velocity 
determine  the  azimuth  (along-t rack ) resolution.  This  is  typically  designed 
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to  be  several  times  higher  than  the  range  ^cross-track)  resolution  so  that 
the  azimuth  return  can  be  divided  into  several  looks  for  incoherent  summation 
to  reduce  the  speckle  noise*  The  range  resolution  is  determined  by  the 
spectral  bandwidth  cf  the  transmitted  pulse.  Coded  pulses  cuch  as  a chirp 

9 

waveform  are  typically  used  to  achieve  the  maximum  resolution  for  a giver* 
level  of  transmitter  power  [8].  During  the  image  processing  these  pulses 
must  be  compressed  to  a point  response.  Imperfect  compression  can  result  in 
both  reduced  resolution  and  range  sidelobes  in  the  imagt ♦ 

2.2  SAR  Processor  Characteristics 

Processing  raw  echo  data  into  finished  imagery  essentially  consists  of 
the  following  four  steps  (16)  : 

(1)  Range  pulse  compression; 

(2)  Doppler  parameter  estimation; 

(3)  Azimuth  correlation;  and 

(4)  Speckle  reduction. 

2.2.1  Range  Pulse  Compression 

The  purpose  of  this  step  is  to  compress  the  time  dispersed  radar 
transmitted  pulse  into  an  impulse.  A chirp  function  is  the  radar  pulse 
waveform  typically  used  because  of  its  focusing  capability  in  an  optical  SAR 
processor.  The  key  to  attaining  an  adequate  signal  "to“  ’ e ratio  is 
ti  insmission  of  a wide-band  pulse  and  use  of  the  data  processor  to  compress 
this  pulse.  The  range  resolution  can  be  approximated  by 

PR  “ 2W  (1 
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where  c is  the  speed  of  light  and  W is  the  pulse  bandwidth*  Spaceborne  SAR 
requires  unusually  large  pulse  compression  ratios  compared  with  aircraft 
radar  to  achieve  fine  image  quality* 

2*2.2  Doppler  Parameter  Estimation 

Formation  of  the  synthetic  aperture  is  critically  dependent  on  accurate 
estimation  of  the  phase  delay  history  of  the  return  echo  signal.  This  phase 
delay  can  be  approximated  by  [9] 


4>(t) 


-4>(0)  + 


2TT^j 


1 A ^ 

V * 2 
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where  4>(0)  is  the  phase  at  t=0,  is  the  Doppler  frequency  shift  of  the 

echv  data* and  f is  the  Doppler  rate,  both  evaluated  at  t=0.  These  two 

parameters,  f and  i'  can  be  estimated  based  on  the  orbit  ^.nd  attitude 
d d 

data,  if  an  accurate  ephemeris  is  not  available,  these  estimates  car  be  used 
as  initial  predicts  ana  further  refined  by  evaluation  of  certain 
characteristics  in  the  resultant  imagery.  Details  of  these  refinement 
techniques,  termed  autof ocusing  lor  and  clutterlock  for  f^,  can  be 
found  in  the  literature  (9, 10 ] . 

2*2.3  Azimuth  Correlation 

One  of  the  primary  features  of  SAR  is  its  very  high  -solution,  /z 
previously  discussed,  fine  range  resolution  is  achieved  by  transmission  of  a 
wide  bandwidth  pulse  and  compression  of  this  pulse  in  the  data  processor.  A 
high  azimuth  resolution  is  achieved  by  coherent  processing  of  echo  date  from 
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successive  radar  pulses.  The  azimuth  correlation  operation  essentially 
simulates  a very  narrow  effective  beamwidth  in  the  azimuth  direction  by 
coherently  adding  the  returns  of  several  radar  echoes.  This  operation  is 
performed  on  range  compressed  data  and  invO.ves  shifting  the  phase  reference 
function  given  in  (2)  and  summing  th^  resultant  detected  echo  data. 

The  complexity  of  the  azimuth  correlation  is  increased  by  the  range 
migration  or  th  . target  as  it  passes  through  the  antenna  bea™.  inis 
migration  consists  of  a range  walk  term  which  is  directly  proper rior^vi  to  the 
elapsed  aiong-track  time  and  a range  curvature  term,  which  is  proportional  to 
the  square  of  the  aiong-track  time.  To  compensate  for  the  iaCt  that  the 
target  transverses  may  range  resolution  elements,  the  in  out  data  is  resampled 
before  * he  phase  reference  function  is  applied.  After  phase  detection,  the 
return  fron  each  pulse  over  the  length  of  the  synthetic  roerture  is  summed  to 
obtain  a refined  estimate  of  the  target's  brightness.  If  the  returns  are 
added  over  the  fuxl  aperture,  a single-look  full  resolution  image  is 
produced.  If  the  aperture  is  divided  into  sections,  sevei^l  single-looh 
reduced  resolution  images  are  produced.  For  example,  two  single-look  images 
can  be  produced  by  dividing  the  phase  reference  function  in  half  and 
processing  the  tirst  and  second  portions  of  the  target  response  separately. 
The  single-look  images  are  then  added  incoherently  as  dv scribed  in  the  next 
section  to  obtain  a multiple-look  xmage. 

2.2.4  Speckle  Reduction 

Coherent  processing  of  radar  echo  data  is  used  to  acnievi  very  fine 
along-ti :ck  resolution,  but  this  same  processing  also  makes  the  ;a^ges 
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susceptible  to  speckling  effects.  Basically*  speckling  results  from 
scattering  of  non-uniformly  distributed  reflectors  within  a resolution  cell 
during  the  period  the  ceil  is  within  the  antenna  beam.  The  speckles  are 
signal  dependent  and  therefore  act  like  multiplicative  noise.  Techniques  for 
speckle  suppression  essentially  fall  into  two  main  categories:  1)  averaging 

* veral  reduced  resolution  images  produced  from  independent  looks;  and 
*:)  filtering  a full-resolution  single-look  image  to  smooth  the  speckle. 

The  multiple-look  overlay  technique  is  typically  used  for  image 
production  because  it  can  achieve  a satisfactory  level  of  specttle  reduction 
with  a minimal  amount  of  additional  computation  [11].  To  produce  multiple 
looks,  the  phase  reference  function  is  divided  into  segments  during  azimuth 
correlation.  Each  segment  is  applied  to  the  appropriate  portion  of  the 
return  echo  data  to  produce  a reduced  resolution  single-look  image  of  the 
target  area.  The  single  look  imagery  is  then  registered  and  averaged  to 
produce  a multi-look  product  with  reduced  speckle  noise. 

The  speckle  can  also  be  reduced  by  filtering  a single-look  high 
resolution  image  [12].  Smoothing  algorithms  have  been  devised  based  on  the 
local  statistics  of  the  noise.  In  general,  these  filters  can  achieve  a 
greater  speckle  reduction  for  a given  resolution  product  then  the 
multiple-look  overlay  technique,  but  because  of  the  additional  computational 
load,  this  approach  is  not  feasible  for  large-scale  image  production. 
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III.  GEOMETRIC  DISTORTION 


SAR  imagery  is  subject  to  several  types  of  geometric  distortion  that 
must  be  corrected  before  the  imagery  can  be  properly  registered  with  other 
sensor  data.  These  distortions  can  be  classifed  into  two  main  categories: 
i)  sensor  derived  distortion,  and  2)  processor  derived  distortion. 

3* i Sensor  Derived  Distortion 

The  geometric  distortions  classified  in  this  category  are  mainly  derived 
from  the  viewing  geometry  of  the  radar.  Design  parameters  such  as  the  sensor 
altituue,  look  angle  , and  range  beamwidth  are  critical  in  determining  the 
degree  of  distortion  in  the  imagery.  In  most  cases,  postprocessing  will  be 
required  to  correct  these  distortion  effects. 

3.1.1  Ground  Range  Nonlinearity 

Perhaps  the  most  predominant  distortion  in  a spaceborne  SAR  image  is  the 
ground  range  nonlinearity.  This  effect  results  from  the  fact  that  each  pixel 
represents  a constant  slanc  range  distance  rather  than  uniform  ground 
spacing.  Figure  2 illustrates  che  type  of  distortion  inherent  in  a slant 
range  projection.  Features  in  the  near  range  of  a slant  range  image  are 
compressed  with  respect  to  the  far  range.  For  example,  a circle  in  the  far 
range  would  have  the  appearance  of  an  ellipsoid  in  the  near  range  of  the 
image.  To  project  the  image  in  a ground  range  format,  the  ground  distance 
represented  by  each  pixel  i.*  the  slant  range  projection  must  be  determined 
lrom 


Ax 


A r 
sin4> 


(3) 
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where  Ar  is  the  slant  range  pixel  spacing  and  4>  is  the  incidence  angle  of  the 
radar  beam  at  the  target.  The  slant  range  spacing  is  constant  and  is  given  by 

Ar  * (4) 

s 

where  c is  the  speed  of  light  and  fg  is  the  sampling  frequency.  The 
maximum  frequency  is  limited  by  the  range  bandwidth.  For  SEASAT  SAR,  this 
frequency  was  45.53  MHz  producing  a slant  range  spacing  of  6.59  m. 

The  incidence  angle,  4>  , can  be  related  to  the  beam  elevation  angle,  0 , 
by  trigonometric  means  as  follows  (Figure  3) 
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where  is  the  radius  of  the  earth,  H is  the  spacecraft  height  and  0 , the 
look  angle,  is  given  by 
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The  relationships  for  4>  and  0 in  (5)  and  (6)  have  been  derived  assuming  a 
smooth  spherical  surface  with  a radius  equal  to  the  radius  of  the  earth  at 
the  target.  Since  the  incidence  angle  is  a function  of  the  terrain,  equation 
(5)  is  ony  approximate  for  a rough  surface.  This  could  result  in  an  error  in 
the  ground  range  projection. 
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3*1*2  Radar  Foreshortening  [13] 

Radar  foreshortening  is  the  variation  in  apparent  size  of  identical 
features  at  different  slopes  with  respect  to  the  sensor.  The  effect  for 
terrain  sloping  toward  the  radar  is  an  increase  in  the  effective  incidence 
angle.  Terrain  sloping  toward  the  radar  will  therefore  appear  elongated  with 
respect  to  terrain  sloping  away  from  the  sensor.  This  is  illustrated  in 
Figure  4.  Since  terrain  features  are  recorded  as  a function  of  the  slant 
range  distance  from  the  sensor,  slope  ab  is  mapped  into  a'b1  in  the  image 
plane  while  be  is  mapped  into  b'c*.  Although  ab  and  be  are  identical  in 
length,  b'c*  will  be  more  than  three  times  larger  than  a'b1  in  the  image. 
Quantitatively  stated  the  elongation  (or  shortening)  factor  is  given  by 


a * b 1 
ab 


sin  ( 0 - i3  ) 
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b'c' 

be 


sin  ( 8 ♦ l3  ) 
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where  ^ is  the  surface  slope  and  8 is  the  look  angle.  Thus  for  a look 
angle  similar  to  the  terrain  slope,  the  foreshortening  effect  is  most  severe. 

The  foreshortening  can  be  corrected  if  the  radar  altitude  and  look  angle 
are  known  and  a terrain  map  of  the  target  area  is  available.  One  technique 
to  correct  the  foreshortening  is  as  follows  ( 14 1 : A digital  topographica 1 

map  is  illuminated  from  the  same  angle  that  the  radar  used  to  generate  the 
original  foreshortened  image.  This  can  be  routinely  done  using  a radar 
simulation  program-  The  resultant  movement  of  each  pixel  in  the  simulated 
image  is  recorded.  This  image  is  then  registered  to  the  actual  radar  image 


173 


and  the  inverse  of  this  movement  is  applied*  The  result  of  this  type  of 
process  is  shown  in  Figure  5*  Note  that  the  presence  of  certain  geological 
features  becomes  readily  apparent.  This  technique,  although  capable  of 
producing  an  inage  without  foreshortening , is  a tedious  process  which 
requires  exact  registration  of  the  simulated  image  with  the  actual  radar 
image*  In  addition,  this  technique  requires  a priori  terrain  information  for 
the  imaged  area  which  may  not  be  available. 

3.1*3  Radar  Layover  [13] 

Radar  layover  is  a distortion  inherent  in  all  radar  imaging  of  irregular 
terrain.  It  results  from  an  image  pixel  being  placed  in  its  cross-track 
location  based  on  its  range  from  the  sensor.  If  the  target  area  contains 
features  with  steep  slopes,  the  top  of  the  feature  can  be  at  a closer  range 
than  the  bottom*  This  effect  is  shown  in  Figure  6.  It  is  especially  severe 
when  features  of  appreciable  level  relief  appear  in  the  near  range* 

3.1*4  Earth  Rotation 

The  earth  rotation  effect  is  common  to  satellite  scanning  systems  where 
the  scan  lines  are  gathered  serially  in  time  while  the  earth's  Surface  is 
rotating  during  the  imaging  period*  This  results  in  the  near  edge  of  the 
image  being  skewed  with  respect  to  the  nadir  track  of  the  satellite  as  shown 
in  Figure  7a.  This  effect,  known  as  range  walk  or  range  migration  can  be 
compensated  by  resampling  the  echo  data  during  the  image  processing. 

Figure  7b  shows  the  outline  of  an  image  frame  after  data  resampling  to 
compensate  for  the  range  walk.  The  stairstep  edge  is  an  artifact  of  the 
multiple-look  overlay  process  and  does  not  result  in  any  discontinuities 
within  the  frame. 
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3.2  Processor  Derived  Distortion 


The  distortions  generated  during  image  formation  are  obviously  dependent 
on  the  specific  processing  algorithm*  Generally , approximations  made  in 
determining  the  phase  reference  function  will  result  in  a skewed  image*  This 
section  discusses  some  typical  approximations  and  the  resultant  distortions* 


3*2*1  Earth  Curvature  and  Rotation 

in  the  previous  section,  the  range  walk  effect  that  results  from  the 

Earth  rotation  was  described.  This  rotation  in  conjunction  with  the  Eirth 

curvature  can  also  result  in  an  image  skew  in  the  azimuth  direction*  This 

skew  occurs  during  the  image  formation  process*  As  previously  discussed,  to 

process  raw  echo  data  into  imagery  the  Doppler  frequency  and  frequency  rate 

must  be  determined*  The  rotation  and  curvature  of  the  earth,  however, result 

in  a complex  Doppler  response  that  is  a function  not  only  of  target  latitude 

but  also  depends  on  target  position  within  the  swath.  A plot  of  Doppler 

frequency  as  a function  of  swath  position  and  latitude  is  >wn  in  Figure  8. 

It  is  extremely  difficult  to  design  a processor  that  adapts  to  the  varying 

frequency  without  introducing  reduced  image  resolution  resulting  from 

misregistration  during  the  raul tiple-look  overlay*  As  an  alternative  to 

precise  tracking  of  the  Doppler  frequency  during  the  processing,  an  optimum 

f is  selected  for  the  entire  image  frame  and  the  resultant  skew  is 
d 

corrected  in  the  post-processing.  This  skew  resulting  from  the  Doppler 
mismatch  is  essentially  in  the  azimuth  direction  as  shown  in  Figure  9*  The 
amount  ot  skew  is  dependent  on  the  difference  between  the  actual  Doppler 
response  of  each  target  and  the  f^  used  in  the  processing  and  is  given  by 


AN 


at 


19) 
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where  PRF  is  the  pulse  repetition  frequency,  L is  the  number  of  looks,  Af^ 

is  the  Doppler  frequency  mismatch,  f^  is  the  Doppler  rate  and  AN^  is  the 

azimuth  displacement  in  pixels.  Note  that  since  the  iso-Doppler  lines  are 

nearly  linear,  a linear  correction  can  be  used  to  deskew  the  image.  For  a 

10(1“  km  swath  width  as  in  SEASAT  SAR,  a typical  skew  is  AN  - 150  pixels  or 

az 

2.5  km»  which  corresponds  to  a skew  angle  of  1.5  degrees. 

3.2.2  Sensor  Parameter  Shift 

The  eccentricity  of  the  spacecraft  orbit  requires  adjustment  of  the 
sensor  parameters  at  certain  intervals  during  the  orbit.  This  can  result  in 
either  a discontinuity,  or  variation  of  the  pixel  resolution  within  an  image 
frame.  A sharp  discontinuity  in  the  image  results  from  a shift  in  the  delay 
of  the  pulse  sampling  window.  This  parameter  shift  is  made  in  the  data 
collection  system  to  maintain  the  optimum  signal- to- noise  ratio  in  the 
sampled  echo  data.  If  the  raise  sampling  window  were  not  adjusted  as  the 
spacecraft  altitude  changed,  this  window  would  not  center  on  the  portion  of 
the  signal  with  the  strongest  return  and  the  resulting  imagery  would  be 
degraded.  The  effect  on  an  image  produced  from  data  collected  during  a 
sampling  window  shift  is  to  displace  one  part  of  the  image  in  range  with 
respect  to  the  other,  resulting  in  a line  of  discontinuity  across  the  frame. 

Another  parameter  requiring  adjustment  based  on  variation  in  the 
spacecraft  orbit  is  the  pulse  repetition  frequency  (PRF).  The  PRF  is 
adjusted  to  prevent  pulse  mixing  or  range  ambiguities.  An  upper  limit  on  the 
PRF  is  set  to  avoid  interference  between  successive  pulses.  This  limit  is 
dependent  on  the  range  swath  width  which  is  in  turn  a function  of  spacecraft 
altitude.  A lower  limit  on  the  PRF  is  determined  by  the  resolution  and 
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azimuth  ambiguity  requirements.  This  bound  is  also  dependent  on  the 
spacecraft  orbit.  To  keep  the  PRF  within  these  bounds,  it  must  be  adjusted 
according  to  variation  in  the  spacecraft  height.  Certain  frames  therefore 
may  contain  pixels  of  mixed  resolution  if  the  PRF  was  adjusted  during  that 
frame* s data  collection  period. 

3.3  Radiometric  Characteristics 

Registration  of  a SAR  image  to  an  optically  sensed  image  or  another  SAR 
image  can  present  a difficult  problem  since  the  apparent  brightness  of  an 
image  pixel  is  critically  dependent  on  the  relative  position  of  the  sensor. 

A small  change  in  the  aspect  angle  can  significantly  alter  the  appearance  of 
a scene  as  shown  in  Figure  10.  Furthermore,  SAR  imagery  is  corrupted  by  both 
speckle  and  thermal  noise,  pulse  compression  sidelobes,  ambiguity  responses 
and  weak  signal  suppression  effects  [6].  With  proper  radar  and  processor 
design,  the  effects  of  most  of  these  distortions  on  the  final  image  product 
can  be  minimized.  The  image  degradation  resulting  from  speckle  noise  is 
greatest  in  coherent  imagery  of  terrain  with  a surface  roughness  comparable 
to  the  wavelength  of  the  illumination  [15].  The  speckle  can  be  reduced  by 
summarion  of  looks  or  filtering  at  the  cost  of  pixel  resolution. 

When  attempting  to  register  SAR  imagery  from  two  adjacent  passes  for  the 

purpose  of  constructing  a mosaic,  the  distortion  resulting  from  speckle  can 

cause  misregistration.  This  results  from  the  fact  that  for  a small  change  in 

the  sensor  position  (4  km  for  SEASAT)  the  speckle  noise  in  the  resultant 

imagery  is  totally  independent.  Therefore,  from  one  pass  to  the  next  a 

feature  may  be  distorted  differently  resulting  in  a poor  correlation  between 

the  two  frames.  An  additional  factor  that  can  cause  image  misregistration 

between  two  adjacent  passes  is  a phenomenon  calleri  specular  point 
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migration  illustrated  in  Figure  11,  This  effect  occurs  wh'jn  a feature  with  a 
varying  slope  is  imaged  from  two  different  sensor  positions*  The  apparent 
position  of  a feature  changes  relative  to  other  features  within  the  frame 
because  the  point  of  maximum  reflectivity  of  that  feature  occurs  at  a slope 
perpendicular  to  the  radar  beam.  This  effect  can  also  result  in  apparent 
misregistration  of  features  in  SAR  imagery. 
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IV*  CURRENT  ?KOGKESS  IN  REG I STRATI ON/ RECTIFICATION  OF  SAR  FREQUENCY 


Many  of  the  ^eometric  and  radiometric  distortions  present  in  digitally 
processed  SAR  imagery  do  not  occur  in  optically  sensed  imagery*  The  effect 
of  these  distortions  on  image  resolution,  rectification  and  ultimately 
mosaicking  have  not  been  fully  investigated*  To  date  very  few  mosaics  have 
been  constructed  with  digital  SAR  imagery  and  at  present  no  comprehensive 
studies  have  been  conducted  to  investigate  the  feasibility  of  generating 
unsupervised  mosaics. 

The  SAR  processing  research  group  at  Jet  Propulsion  Laboratory  has  laid 
the  ground  work  for  development  of  an  unsupervised  mosaicking  procedure  and 
plans  to  implement  this  procedure  within  the  next  year*  Recently  completed 
is  an  algorithm  capable  of  determining  the  absolute  location  of  an  image 
pixel  without  the  aid  of  ground  reference  points  [6]*  This  algorithm 
utilizes  information  provided  by  the  spacecraft  ephemeris  and  characteristics 
of  the  sensor  data  collection  system  to  predict  the  latitude  and  longitude  of 
an  arbitrary  image  pixel. Tests  have  rhown  this  technique  has  an  accuracy  of 
better  than  200  m for  SEASAT  SAR  data.  The  target  location  uncertainty  is 
primarily  dependent  on  the  accuracy  of  the  spacecraft  position  and  velocity 
provided  by  the  ephemeris  and  the  validity  of  the  assumed  geoid  in  the  target 
area. 


The  capability  for  unsupervised  pixel  location  is  a prerequisite  for 
automated  rectification  and  mosaicking  of  SAR  imagery*  With  informtion  on 
both  the  sensor  and  target  position,  the  parameters  for  slant  range  to  ground- 
range  conversion  can  be  determined  as  well  as  the  Doppler  shift  in  the  echo 
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data.  Using  this  information  and  the  image  processing  parameters,  it  is  a 
simple  procedure  to  conduct  range  and  azimuth  interpolation  to  remove  the 
ground  range  nonlinearity  and  azimuth  skew  distortions.  An  algorithm  has 
been  developed  at  JPL  to  correct  these  distortions  for  digitally  cor"  » d 
SEASAT  imagery.  A preliminary  version  of  this  algorithm  has  been  piemens 
utilizing  the  hardware  architecture  of  the  digital  processor-  This  hardware 
configuration,  shown  in  Figure  12,  was  designed  both  for  efficiency  and 
economy  [17].  The  host  computer  is  a Systems  Engineering  Laboratory  32/77 
which  features  very  rapid  I/O  data  transfers.  Attached  to  the  host  are  three 
Floating  Point  Systems  AP120b  array  processors  and  four  300  Mbyte  discs.  The 
image  data  is  transferred  from  disc  to  the  array  processors  through  the 
host.  Each  AP  operates  simultaneously  on  a separate  area  of  the  image  and 
returns  the  rectified  product  to  the  host  to  be  merged  and  transferred  to 
disc.  It  is  anticipated  that  with  proper  design  this  approach  can  rectify  a 
6000  x 6000  pixel  frame  which  covers  a 100  x 100  km  ground  area  in  under 
30  minutes.  This  approach  is  compatible  with  the  image  processor  and  could 
be  easily  incorporated  into  the  image  production  procedure. 

A preliminary  version  of  this  algorithm  is  curr^vtly  operating  at  JPL. 

It  utilizes  a single  AP  and  makes  some  simplifying  assuraptxons  in  generating 
the  rectification  parameters.  The  current  operating  time  for  a full  frame 
is  80  minutes.  The  output  has  been  resampled  to  12.5  m spacing  in  both  the 
range  and  azimuth  dimensions-  As  a result  of  approximation,  the  rectified 
product  still  contains  some  residual  skew.  Tests  show  approximately  a 200  m 
registration  error  across  a 100-km  frame.  The  expected  registration  error 
using  a more  exact  version  of  the  algorithm  is  less  than  50  m or  about 
2 pixels. 
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Following  completion  and  test  of  the  rectification  algorithm,  studies 
are  planned  to  investigate  the  feasibility  of  generating  unsupervised  image 
mosaics.  Imagery  from  parallel  passes  as  well  as  ascending  and  descending 
passes  will  be  examined.  Statistics  will  be  compiled  on  the  correlaticn  of 
common  features  as  well  as  the  misregistration  between  geometrically 
corrected  images  from  two  adjacent  passes.  Automated  feature  detection 
techniques  are  also  being  considered  to  locate  suitable  tie  points. 

Obviously  much  work  remains  to  be  done  with  regard  to  rectification  and 
registration  of  SAR  imagery.  It  is  clear  that  digitally  correlated  imagery 
offers  distinct  advantages  over  optical  imagery  such  as:  reproducible 

processing,  large  inherent  dynamic  range  and  highly  accurate  pixel  location. 
The  refinement  of  these  techniques  utilizing  SEASAT  SAR  data  will  provide 
insight  into  the  design  of  future  sensor  systems  to  optimize  the  registration 
and  rectification  accuracy. 
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Figure  1.  Viewing  geometry  for  a typical  side-looking  synthetic  aperture  radar 
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Figure  2.  Slant  range  to  ground  range  nonlinearity  inherent 
in  all  side  looking  radar  systems.  Near  range 
features  are  compressed  relative  to  far  range 
features  because  of  change  in  incidence  angle,  0 . 
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Figure  3.  Relationship  between  look  angle,  and  incidence 
angle  c tor  a smooth  spherical  planet  surface. 
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Figure  5.  Results  of  i onipensat  i on  for  radar  f oreshor tuning  using 
digital  terrain  node!.  a)  Simulated  radar  image  from 
t o p o graph  i e. a l ma v , b)  Co r r e e.  l ed.  S KA SAT  ini  a ge  , c)  Origi- 
nal SKASAT  image.  Note  the  enhaneement  of  fault  lines 
not  evident  in  original  image  tNaraghi,  1981). 
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Figure  6,  Radar  layover  is  a function  of  the  terrain 

slope  and  the  slant  range  to  the  target.  Layover 
occurs  when  the  surface  feature  slope  exceeds  the 
look  angle.  Signal  scattered  from  the  top  of 
features  1 and  2 will  be  placed  at  a nearer  cross- 
track position  in  the  image  than  signal  scattered 
from  the  bottom. 
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Figure  7.  Range  migration  of  the  ground  track  resulting  from 
earth  rotation  during  the  imaging  period  is  shown 
in  a.  The  range  skew  distance  is  given  by  dr  = Vev\t 
where  Vc  is  the  velocity  of  the  earth  and  At  is  the 
imaging  time  for  the  frame.  The  cross  track  skew 
shown  in  b is  applied  during  the  image  formation. 
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Figure  8.  Plot  of  Doppler  frequency  as  a function  of 

swath  position  and  latitude.  Nominal  values 
for  SEASAT  SAR  were  assumed  for  spacecraft 
in  descending  mode  (Wu,  1981), 
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Figure  10.  Effect  of  radar  aspect  angle  on  the  apparent 
brightness  of  target.  Figure  ICa  was  imaged 
during  a descending  mode  and  Figure  10b  during 
an  ascending  mode 
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Figure  11*  Specular  point  migration  results  when  sensor  images 
the  same  feature  from  two  different  positions. 

Point  of  maximum  return  is  dependent  on  target  slope 
and  may  vary  relative  to  other  features  within  the 
fra  a. 
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Figure  12.  Block  diagram  of  digital  processing  system  at 
Jet  Propulsion  Laboratory.  Data  is  recorded 
on  high  density  digital  tape  (HDDT)  at  the 
tracking  station.  It  is  received  at  the 
processing  facility  via  an  optical  link  and 
recorded  on  disk  for  processing  (Wu,  1981) . 
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5.7  SPACECRAFT  INDUCED  ERROR  SOURCES* 

« y > ■ 

H.  Heuberger,  GSFC 

I'm  going  to  say  a few  words  about  spacecraft  induced  error  sources,  basically 
attitude  errors  on  the  Landsat  spacecraft,  the  1,  2,  3 and  D,  and  ephemeris 
errors  from  various  tracking  systems. 

First,  I want  to  talk  about  the  attitude  control  system  and  attitude  measure- 
ment system  on  Landsat-2  (actually  1,  2,  and  3 as  they  are  basically  the 

same)  . Table  I reviews  the  kind  of  attitude  information  we  had  to  work  with 
on  those  three  spacecraft.  The  attitude  control  system  uses  horizon  scanners 
and  gyros  to  solve  for  pitch  and  roll  directly,  and  once  those  are  brought  in, 
there  is  a gyro  in  the  ro’ 1/yaw  plane;  knowing  the  roll  and  the  rate  from  that 
gyro,  you  can  solve  for  yaw  and  bring  the  yaw  error  in. 

TABLE  I 

Landsat-2  Attitude  Control  and  Measurement 


o Attutude  Control  System  (ACS) 

Horizon  scanners  and  gy» os  provide  pitch  and  roll  ^rr or  sensing 
Rate  Measurement  Package  (RMP)  in  roll/ yaw  plane  used  to  determine 
yaw  error 

Pointing  Control  = 0.1  deg 
Pointing  Stability  = 0.01  deg/s 

o Attitude  Measurement  Sensors  (AMS) 

- Independent  of  ACS 

- Horizon  scanners  fore  and  aft  determine  pitch  and  rolL 

- Yaw  assumed  proportional  to  roll 
Measurement  accuracy  = 0.1  deg 

Horizon  scanners  susceptible  to  atmospheric  effects  (e.g.,  cold 
clouds) 

The  specification  on  the  platform  is  a pointing  control  of  .1°  and  stability 
of  .01°  per  second.  Now  on  that  spacecraft  the  measurement  system  or  what  we 
actually  know  about  the  attitude  is  independent  of  the  control  system.  We 
have  infrared  horizon  scanners  for  pitch  and  roll.  There* s nothing  though 
that  gives  us  the  yaw  error  so  we  assume  itfs  proportional  to  roll.  Basically 
because  of  the  way  the  control  system  solves  for  yaw,  we  have  the  same  speci- 
fication there  of  .1°. 

What  people  are  really  seeing  is  quite  a * 't  worse  because  the  infrared  hori- 
zon scanners  are  susceptible  to  cold  clouds  etc.  Depending  on  who  you  listen 
to,  .5°  is  not  unusual  — even  possibly  1°.  I've  heard  numbers  like  that.  On 
the  last  slide.  I'll  translate  all  these  numbers  into  what  an  image  error 
would  be  from  tnat  type  of  attitude  error. 
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Table  II  reviews  the  situation  on  Landsat-D.  It  is  the  same  as  the  previous 
Landsats  for  course  acquisition  and  there's  a fine  sun  sensor  that's  used  for 
transition  and  the  nominal  mode  is  star  trackers  and  gyrci.  Star  trackers  end 
the  gyro  information  are  filtered  to  update  quaternians  e id  actually  the  star 
trackers  are  used  to  update  the  gyro  drift.  We  have  a much  improved  system 
here,  as  we  have  pointing  accuracy  advertised  as  .01°  and  very  good  stability, 
and  from  talking  to  different  people,  that's  the  specification  and  it  seems  to 
be  that  it  will  be  achievable.  In  fact,  we  may  do  quite  a bit  better  than 
that  by  a factor  of  2 or  something.  On  Landsat-D,  the  attitude  measurunerts 
cane  from  the  control  system  Kalman  filter  and  the  DRIRU. 

TABLE  II 

Landsat-D  Attitude  Control  and  Measurement 

o Same  as  Landsat-2  for  coarse  acquisition 
o Fine  sun  sensor  used  for  transition  to  fine  acquisition 

o 2 star  trackers  and  6 gyros  (3-axis  redundant)  used  to  update  quaternians 

o Pointing  accuracty  s .01  deg 

o Pointing  stability  = 10"®  deg/s 

o Attitude  measurements  from  control  system  Kalman  filter  and  DRIRU 

Quaternians  every  4.096  s 
Gyro  measurements  every  64  ms 


Table  Ilia  reviews  the  ephemeris.  I'm  not  contrasting  Lar.dsat  1,  2,  and  3 
against  D because  basically  they're  the  same  class  of  spacecraft.  It  depends 
on  what  type  of  data  you  have  to  work  with  for  ephemeris  error.  Now  some  of 
these  nunbers  you've  already  seen  frcm  the  GE  people,  in  fact  some  of  these 
numbers  come  off  GE's  slides.  The  altitude  variation  is  due  to  earth  oblate- 
ness and  variations  in  eccentricity  etc.  Along-track  variation  is  not  by  it- 
self too  important  because  the  spacecraft  is  basically  following  the  same 
ground  path.  Dr.  Prakash  said  four  kilometers  cross-track;  I got  5 kilometers 
frcm  the  people  who  are  responsible  for  the  orbit  control.  That's  probably 
the  most  Important  nunber  there.  If  Mr.  Billingsly  was  talking  about  relief 
displacement,  that's  the  kind  of  number  we  would  be  looking  at  for  relief  dis- 
placement, if  you  were  5 kilometers  off  on  your  look  angle  there. 

With  conventional  processing,  ana  operational  processing  of  the  Goddard  net- 
work and  standard  nettork,  we  generally  can  get  around  100  meters  in  ephemeris 
error.  This  is  definitive,  as  you  get  24  hovrs  of  data  and  do  a least  squares 
fit  to  orbit  or  doppler  data  and  do  a batch  fit  or  sequential  filter.  You  can 
characterize  errors  pretty  reliably  and  usually  find  100  meters  or  better. 
Orbit  predicts  (a  second  method)  generally  represent  what  is  uplinked  to  the 
spacecraft.  They  claim  these  are  2-day  predicts;  1 would  think  they  would  be 
more  like  1-day  predict  nunbers.  Five-hundred  meters  after  2 days  is  doing 
pretty  good;  I would  say  1 day  or  somewhere  in  there.  All  of  these  numbers 
are  1-sigma  nunbers  and  it  depends  on  who  you  talk  to  and  what  your  assump- 
tions are. 

Table  Illb  looks  at  tracking  systems  of  the  future.  On  Landsat  D,  using  TDRS?. 
data  and  from  simulations  and  error  analysis,  we  find  out  we  can  do  about  the 
same  that  we  do  now — processing  24  hours  of  TDRSS  data  may  get  you  90  meters. 
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TABLE  Ilia 


Landsat-D  Orbit  Variations  and  Ephemeris  Accuracy 

o Variations  from  nominal 

Altitude  (705.3  km  nominal) 

- 696  to  741  km  over  earth 

19  km  variation  over  fixed  latitude 

Along  track:  + 95  km 

- Cross  track:  + 5 km  at  equato 

Inclination:  98.21  + .045  deg 

o Conventional  Processing  Ephemeris  Error  (GSTDN  Data) 

Operation 

Post  Processing  Orbit  Predicts 


Along  track 

100  m 

500 

Cross  track 

30 

100 

Radial 

20 

35 

RSS 

105 

510 

you  might  do  slightly  better  generally,  but  it's  about  the  same  measures  as 
using  the  ground  tracking.  The  really  good  news  is  the  GPS,  the  Global  Posi- 
tioning System,  which  is  a system  of  DOD  satellites  and  navigational  develop- 
ment satellites,  which  will  significantly  reduce  ephemeris  errors.  As  a re- 
sult, the  combined  attitude  and  ephemeris  errors,  as  shown  .n  Table  IV,  are 
expected  to  experience  better  than  an  order  of  magnitude  improvement  over  the 
previous  Landsats. 


TABLE  IIIb 

Landsat-D  Ephemeris  Accuracy  (cont.) 
o Ephemeris  Error  with  TDRSS 

Definitive  Orbits 


Along  track 

80  m 

Cross  track 

30 

Rad ial 

25 

RSS 

90 

Ephemeris  Error  with  GPS 

4 nds.  Inview  Poor  Visibility 


Along  track 

10  m 

50  m 

Cross  track 

6 

25 

Radial 

4 

20 

RSS 

12 

60 
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TABLE  IV 


Attitude/Ephemeris  Scene  Distortions 


Along/ Cross-Track  Error  (MET) 


Distortion 

Land sat-2  AMS 

Landsat-D  , 

Source 

GSTDN  Tracking 

GPS 

ATTITUDE 

Pitch 

1570/- 

123/- 

Roll 

- n 585 

- /1 25 

Yaw 

160  / - 

12*1  / 125 

EPHEMERIS 

Along  Track 

100  / - 

10  / - 

Cross  Track 

- / 30 

- / 6 

Radial 

- / 3 

- / - 

RSS 

100  / 30 

10/6 
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5.8  ^ HAVSTAR/GLOBAL  POSITIONING  SYSTEM* 

of 

M.  Ananda,  The  Aerospace  Corporation 

The  Global  Positioning  System  (GPS)  has  been  developed  to  provicie  highly  pre- 
cise position,  velocity,  and  time  information  to  users  anywhere  in  the  neigh- 
borhood of  earth  and  at  any  time.  The  GPS,  when  fully  operational,  will  con- 
sist of  18  satellites  in  six  orbital  planes.  These  satellites  will  be  at 
about  20,000  km  altitude  with  a 12-h  period  and  the  orbits  will  be  inclined  to 
55°.  The  satellites  will  transmit  L1  (1575.42-MHz)  and  L?  (1227.6-MHz)  sig- 
nals. Navigation  information  such  as  the  emphemeris  of  the  satellites  and 
satellite  clock  model  parameters  and  the  system  data  are  superimposed  on  these 
radio  signals.  Any  GPS  user,  by  receiving  and  processing  the  radio  signals 
from  the  constellation  can  instantaneously  determine  navigation  information 
(position  and  velocity  parameters)  to  an  accuracy  of  about  15  m in  position 
and  0.1  m/s  in  velocity.  T!  is  radio  navigation  system  is  primarily  developed 
for  utilization  by  the  Department  of  Defense.  However,  there  exists  a broad 
spectrum  of  civil  users  who  would  benefit  from  this  system. 

The  GPS  system  has  three  separate  segments.  One  is  the  space  segment,  which 
is  the  satellite  itself,  then  what  we  call  a control  segment,  which  is  respon- 
sible for  providing  the  information  to  the  satellite,  and  the  third  is  the 
user  segment.  The  user  segment  includes  individual  user  MANPAC  or  automo- 
biles, trucks,  ships,  aircrafts,  and  satellites.  With  regard  to  program  his- 
tory, originally  tie  Navy  was  responsible  for  initiating  a navigation  system, 
the  TRANSIT  program — and  it  is  still  operational  now.  They  have  five  satel- 
lites and  the  accuracy  is  reasonable.  The  GPS  mission  program  was  a prelimi- 
nary study  which  the  Navy  originated  and  621-B  was  a program  the  Air  Force 
initiated;  they  were  subsequently  combined  and  t°came  the  Global  Positioning 
System.  During  the  program  evolution  there  are  uttree  phases:  (1)  the  concept 
validation  phase,  (2)  the  full-scale  engineering  development  and  testing  (pre- 
sent phase),  and  (3)  full  operation  capability.  In  Phase  I we  had  four  satel- 
lites and  two  planes;  in  Phase  II  we  have  6 satellites;  however,  one  of  the 
satellites  is  not  functioning  properly  because  of  the  on-board  clock.  It  is 
not  giving  the  accuracy  we  need.  In  Phase  III  we  will  eventually  have  18  sat- 
ellites and  this  will  be  a different  satellite  than  what  we  have  now. 

Let's  briefly  look  at  the  space  segment.  Once  we  have  18  satellites,  each 
satellite  will  be  in  a 12-hour  period  at  20,000  km  altitude.  (Figure  1).  Cur- 
rent clock  accuracy  is  about  1:10“'' 3 to  5:10"  . Clock  performance  is  ex- 
tremely good  even  though  the  design  specifications  show  only  2: 10“' 3.  We  have 
two  L-band  frequency  signals,  L-1  and  L-2,  at  1.2  GHz  and  1.5  GHz,  and  we  also 
have  an  L-3  but  that's  not  a user  oriented  band,  it  is  used  for  a specific 
purpose.  We  may  use  that  L-3  which  is  a cross-link  capability  from  one  satel- 
lite to  another  satellite. 

Now  the  concept  of  getting  navigation  information  from  the  GPS  satellites. 
The  satellites  will  provide  signals  from  which  you  can,  if  you  have  a receiv- 
er, get  range  information  and  simultaneously  if  you  can  get  full  range  infor- 
mation properly  distributed  in  the  sky,  you  can  determine  your  own  position 
and  the  bias  in  your  clock.  If  your  clock  is  not  as  precise  as  the  satellite 
clock,  you  can  determine  instantaneously  our  precision  plus  the  timing  bias. 
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If  you  have  the  range  rate  information  in  addition  to  the  range  information 
you  can  also  determine  the  velocity  if  you  are  a user.  The  accuracy  we  are 
currently  broadcasting  (Figure  2)  we  would  get  is  15  meters  of  spherical  dis- 
tributed error  for  all  these  types  of  users,  whether  a MANPAC,  an  automobile, 
ship,  aircraft  or  Shuttle.  When  you  deviate  from  800-1,000  km  altitude,  like 
Landsat,  you r accuracy  will  be  improved  because  of  some  of  the  errors  are  as- 
sociated with  atmospheric  modeling. 

In  comparison  of  navigation  systems  (Figure  3),  the  GPS  is  a navigation  system 
purely  based  upon  radiometric  measurements.  There  are  a quite  a large  number 
of  navigation  systems  in  existence.  Currently,  L0RAN-C,  OMEGA,  INS,  TACAN, 
TRANSIT — these  are  all  radio  based  navigation  systems.  The  TRANSIT  is  probab- 
ly closer  to  GPS  because  it  has  a global  capability;  however,  the  accuracy  de- 
grades in  between  orbits.  GPS  provides  the  same  accuracy  globally  everywhere 
anytime.  That's  the  key  point.  In  other  systems  the  errors  are  fairly  large 
and  obviously  there  is  a lot  of  lost  information  you  will  not  receive.  GPS  is 
a very  simple  concept  and  versatile,  and  obviously,  a very  expensive  system 
also.  For  user  equipment,  as  I said  earlier,  you  need  to  have  four  satellites 
simultaneously  visible.  Simultaneous  in  the  sense  that  you  don't  need  to  have 
a four-channel  receiver  in  order  to  do  it;  you  can  do  it  sequentially.  How- 
ever, the  four  satellites  have  to  be  available  to  the  user  and  the  constella- 
tion is  designed  to  be  able  to  achieve  at  least  four  satellites  at  any  given 
time,  anywhere  near  the  earth. 

The  performance  of  the  user  system  depends  upon  several  things  (Figure  4). 
The  vehicle  environment  — of  concern  in  particular  to  defense  related  prob- 
lems and  constellation  geometry  — is  very  geometry  dependent  and  dependent  on 
the  dynamics  of  the  vehicle  and  the  way  the  ionosphere  and  troposphere  are 
modeled.  The  ionosphere  can  be  monitored  better  if  you  have  a two-channel  re- 
ceiver because  you  have  two  frequencies  going  in  and  separated  in  frequencies 
so  we  can  calibrate  real  time.  For  a single  receiver,  we  have  provision  in 
the  navigation  message  which  will  provide  some  kind  of  table  for  modeling  the 
ionospheric  effects.  It  may  not  be  very  accurate,  but  sufficient  for  that 
type  of  user. 

Reviewing  the  error  budget  (Figure  2),  true  navigation  error  is  a product  of 
what  we  call  GE0D0FF,  that  is,  geometry  delusion  of  precision.  If  you  multi- 
ply the  GECDOFF  times  the  user  equivalent  range  error  component  you  get  the 
navigation  error.  The  GE0D0FF  data  varies  from  one  place  to  another  place  and 
the  best  GE0D0FF  is  2 or  2.2.  So  if  the  satellite  dependent  range  error  is 
multiplied  by  2.2,  it  would  give  you  around  15-meter  accuracy,  which  is  the 
total  of  the  various  error  sources.  The  satelite  clock  is  minus  13  over  a 
24-hour  period  and  we  update  once  in  10-hours.  Each  clock  will  have  a differ- 
ent elapsed  time  because  the  update  time  will  be  different  for  each  satellite. 
A single  satellite  will  be  visible  once  or  twice  a day  from  a given  ground 

control  station.  Another  interesting  element  is  that  if  you  use  GPS  in  a rel- 
ative mode  for  a relative  navigation,  all  these  errors  tend  to  cancel  out.  So 
the  only  error  you  will  be  left  with  is  a user  related  erro1*  of  approximately 
2 meters.  Most  of  the  civilian  types  of  purposes  can  be  used  in  a relative 
mode  depending  on  what  your  particular  application  is.  For  that  reason,  we 
have  what  we  call  for  security  purposes  selective  availability,  so  we  cannot 
guarantee  any  user  the  real  accuracy  the  system  would  provide.  However,  the 
degraded  accuracy  would  be  available  to  everyone.  We  don't  know  what  the  de- 
graded accuracy  is  or  whether  it  will  be  opted;  those  decisions  are  to  be  made 
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at  a much  higher  level,  but  we  have  the  ability  to  introduce  whatever  error  we 
want.  However,  that  will  not  affect  a user  using  a relative  mode. 
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ORIGINAL  p;.T,r  VJ 
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♦Degraded  clock  and  ephemeris 

Figure  1.  Relative  Navigation 
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Figure  2.  User  Equivalent  Range  Error  Budget 
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Systam 

Portion 

Accuracy 

(ml 

Velocity 

■ - >cy 
tm/iec) 

Range  of 
Operation 

Comments 

GPS 

IK  IQCPI 

30 

0.1  (RMS  par 
axlt) 

Worldwide 

Operational  worldwide  with  24  hour 
all  weather  coverage. 

Loran-C 
(Note  1) 

180  (CEP) 

No  velocity 

data 

U.S.  Coast, 
Continental 
U.S.,  Selected 
Overseas  areas 

Operational  with  localized  coverage. 
Limited  by  tkyweve  interference. 

Omega 
(Note  1) 

2,200  (CEP) 

No  velocity 
data 

Near  global 
(90%  coverage) 

Currently  operational  with  localized 
coverage.  System  it  subject  to  multi  - 
path  errors. 

Std  INS 
(Nota  2) 

1,500  max 
alter  1st 
hour  (CEP) 

0.3  after  2 hr 
(RMS  per  axis) 

Worldwide 

Operational  worldwide  with  24  hour 
al>  weather  coverage.  Degraded  per- 
formance In  polar  areas. 

TACAN 
(Note  1} 

400  (CEPI 

No  velocity 

data 

. 

Line  of  sight 
(presont  air 
routes) 

Position  accuracy  is  degraded  mainly 
because  of  azimuth  uncertainty  which 
is  typically  on  the  order  of  ±1.0 
degree. 

Transit 
(Not-  3| 

200  (CEP) 

1 

No  velocity 
data 

Worldwide 

The  Interval  between  position  fixes  Is 
about  90  minutes.  Tor  use  ■ slow 
moving  vehicles 

NOTES:  1.  Federal  Radio  Navigation  Plan,  July  1680 

2.  EN AC-77  IV,  Characterlitic  for  a Moderate  Accuracy  Inertial  Navigation  System, 
August  1970 

3.  Journal  of  the  Institute  of  Navigation,  Volume  27,  No.  2,  Summer  1979 


Figure  3.  Navigation  System  Comparison 


Figure  4.  UE  Set  Performance 
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6.0  PRESENTATIONS  ON  GROUND  SEGMENT  ERRORS 


6.1  SUMMARY 

The  position  papers  on  ground  segment  errors  reviewed  the  underlying  theory 
for  essential  elements  in  the  rectification  pr^-ess  and  also  reviewed  posi- 
tional accuracy  standards.  Geodetic  control  can  be  characterizes  as  we??  es- 
tablished in  developed  countries  but  having  somewhat  more  poorly  developed 
networks  in  many  other  parts  of  the  world.  Furthermore,  it  is  frequently  dif- 
ficult to  obtain  geodetic  information  in  many  countries  as  it  is  considered  of 
strategic  value  and  each  country  has  a different  datum  upon  which  it  bases  its 
horizontal  control.  As  a result,  rectifying  spacecraft  to  a particular  map 
projection  within  map  accuracy  standards  must  be  considered  on  a ca?e-by-case 
ba**is  for  most  areas  of  the  world. 

National  Map  Accuracy  Standards  (NMAS)  apply  to  both  horizontal  and  vertical 
position  error.  A fundamental  relationship  between  spatial  resolution,  x-y 
positional  error,  and  vertical  elevation  error  points  out  that  vertical  reso- 
lution capability  is  twice  the  nominal  spatial  resolution  for  a stereographic 
pair  of  images.  Thus,  a 5-meter  IFOV  resolution  system  could  provide  10-meter 
elevation  contour  interval  data.  This  fact  combined  with  national  map  accura- 
cy criteria  would  indicate  ';hat  a 15-meter  resolution  system  could  achieve 
1:50,00^  NMAS  planimetrically  but  only  1:250,000  NMAS  for  topographic  mapping. 

The  review  of  map  projections  illustrated  salient  points.  First,  all  projec- 
tions distort  the  real  condition  extant  on  the  spherical  earth  in  some  way. 
As  a result,  each  map  must  compromise  size,  shape,  or  area.  The  smaller  the 
scale,  i.e.,  the  larger  the  , gion  being  displayed  on  a map,  the  more  apparent 
these  distortions  become.  Most  maps  in  use  today  art  based  on  lines  of  longi- 
tude, or  meridians,  and  therefore  are  oriented  north/south  and  ea3t/west.  The 
Space  Oblique  Mercator  projection  in  use  with  Landsat  MSS  data  is  based  upon 
the  nadir  track  of  the  spacecraft,  a convention  which  eases  computational  con- 
siderations. However,  because  of  the  nadir  tracks'  continuous  positional 
changes  with  each  overpass,  this  projection  undergoes  continuous  variation, 
resulting  in  its  not  being  adopted  by  the  majority  of  the  map-base  oriented 
users. 
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Geodetic  Control  nets  are  built  over  time  depending  on  the  resources  avail- 
able, In  the  U.S.  the  situation  around  1900  looked  like  Figure  1.  You  had  a 
translation  scheme  along  the  east  coast,  you  had  some  activity  around  the 
great  lakes,  and  the  major  accomplishment  of  25  to  30  years  was  the  Transcon- 
tinental Arch  of  Triangulation.  So  that  was  the  first  time  when  people  even 
knew  how  far  it  was  fran  one  coast  to  the  other  one.  By  1931  (Figure  2),  the 
situation  had  changed  to  a rather  nicely  developed  pattern  with  the  arch  of 
triangulation  going  North,  South,  East,  and  West.  You  see  in  Fig*  2 ex- 
tremely large  triangles,  and  the  basic  principle  of  triangulation  ob  rvations 
is  that  one  measures  the  angles  in  a triangle  and  occasionally  one  measures  a 
distance  between  two  points,  a side  of  a triangle.  By  that  you  can  compute 
the  coordinates  and  resolve  all  the  unknowns  in  the  triangle  and  get  coordi- 
nates. If  you  have  a starting  value,  you  can  build  upon  that  as  you  go  along. 
The  accuracies  that  are  involved  depend  very  much  on  how  frequently  you  update 
your  distance,  because  that  is  the  most  degrading  effect.  By  1946  the  situa- 
tion in  North  America  looked  like  Figure  3:  a highly  developed  system  in  the 

conterminous  United  States  with  hardly  anything  in  Canada,  some  attempts  do 
sometning  in  Alaska,  and  a development  in  Mexico  by  virtue  of  the  Inter- 
American  Geodetic  Survey.  By  1946  the  number  of  points  reached  over  a 100000 
in  the  U.S,  The  situation  as  it  stands  today,  looks  like  Figure  4.  In  the 

conterminous  U.S.  it  has  grown  to  an  inventory  of  about  250,000  points. 
Canada  has  also  made  progress;  there  is  significant  progress  in  A1  .ska,  and 
one  should  expect  much  more  in  Alaska  with  the  current  developments  in  energy. 
The  control  net  has  been  pushed  all  the  way  through  the  Central  Airerican 
Republics  into  the  northern  part  of  South  America  with  all  of  the  connections 
to  'slaods. 


The  instruments  that  are  used  to  build  a horizontal  network  have  been  primari- 
ly the  theodolites  and  they  are  considered  part  of  the  classical  arsenal  of 
instrumentation.  We  can  measure  directions  with  the  theodolites  to  a standard 
error  of  about  6/10  of  a second.  We  now  have  electronic  distance  measuring 
instruments  which  can  measure  distances  most  accurately  to  1 part  in  a million 
of  the  distance.  We  make  satellite  doppler  observations  which  give  us  point 
positions  with  accuracies  of  standard  deviations  of  level  of  less  than  1 
meter.  In  recent  years,  inertial  survey  systems  have  been  developed  and  they 
are  primarily  used  for  identification  purposes.  For  the  future,  there  will  be 
Global  Positioning  Satellites,  but  in  our  concept  it  will  come  down  to  stand- 
ard deviations  between  2 and  4 centimeters.  That  is  the  difference  from  the 
15-meter  and  6-meter  deviations  mentioned  before.  The  point  is  we  have  more 
time,  ve  don’t  need  it  instantaneously.  We  can  sit  there  at  the  station  for  a 
nurber  of  hours  and  that  will  improve  the  accuracy.  Furthermore,  we  will  use 
GPS  only  in  a relative  mode  because  we  have  200,000  points  already.  We  can 
put  one  receiver  at  a known  point,  and  then  relatively  position  any  other 
point  within  200  km  from  the  first  point,  to  this  kind  of  accuracy. 

The  relative  and  absolute  accuracies  of  the  U.S.  horizontal  network  are  shown 
in  Figure  5.  We  distinguish  between  several  orders  of  accuracy.  The  first 
order  is  the  most  precise  one,  it  has  direct  accuracy  of  1 in  a 100,000  and 
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the  others  just  decrease  to  1 in  5,000.  What  is  more  interesting  possibly  for 
this  audience  is  the  absolute  accuracy  of  the  U.S.  network  which  is  on  the 
North  American  datum  of  1927.  The  accuracy  in  the  absolute  sense  is  about  15 
meters,  and  that  is  due  to  the  existing  distortions  in  the  network.  We  arc 
actively  working  now  on  a project  that  will  give  the  North  American  Datum  in 
1983,  where  all  positions  will  be  known  to  about  1/2  meter.  That  1/2  meter 
refers  to  the  worst;  we  contemplate  just  4-5  centimeters  precision  for  some  of 
the  best  points  in  the  network. 

For  the  U.S.  network  on  the  1927  datum,  all  points  are  related  to  a mathemati- 
cal surface  which  is  an  ellipsoid  placed  in  space  many  many  years  ago,  in  such 
a way  that  there  is  an  offset  with  respect  to  the  Geoeenter  of  22  meters  in  x, 
157  meters  in  y,  176  meters  in  z.  These  numbers  are  not  to  be  looked  at  as 
errors,  but  they  are  very  well  known  numbers.  Still,  we  will  move  the  mathe- 
matical surface  from  one  point  to  another  point  because  when  this  was  done 
originally  no  one  knew  where  the  earth’s  geocenter  was.  But  today  because  of 
satellites  it  is  very  easy  to  determine  where  the  Geocenter  is.  The  most  sig- 
nifi  ant  datum  defined  by  the  Defense  Department  was  the  world  generic  system 
of  1972.  We  know  these  nunbers  that  relate  to  the  U.S.  datum,  but  we  also 
know  these  numbers  for  the  other  datums.  Figure  6 gives  an  example  of  the  ma- 
jor datums  in  the  world  and  what  these  shifts  to  the  Geocenter  are,  but  you 
see  that  these  numbers  vary  depending  on  how  these  datum  were  defined  to  begin 
with.  The  thing  that  needs  to  be  remembered  is  that  one  cannot  apply  one 
philosophy  to  all  datums  and  assume  that  they  are  all  consistent  in  the  same 
coordinate  system.  Each  of  them  is  a separate  coordinate  system,  and  in  order 
to  make  one  earth  coordinate  we  have  to  take  all  of  these  datums  and  shift 
them  to  one  common  place,  an*  the  most  logical  common  place  today  is  the  geo- 
center. International  meetings  have  agreed  that  the  geocenter  makes  sense. 
The  International  Association  of  geodesy  has  defined  the  geodetic  reference 
system  of  1980  as  a geocentric  system. 

The  availability  of  geodetic  information  within  the  U.S.  is  the  responsibility 
_,f  the  National  Geodetic  Survey  and  the  information  is  freely  available  in 
this  country.  That  is  not  the  case  in  general.  Other  countries  have  looked 
at  geodetic  activities  very  much  in  terms  of  their  military  establishment.  As 
a consequence  the  information  is  generally  unavailable  because  these  countries 
classify  the  information.  However,  there  are  old  publications  that  you  can 
find  that  show  what  these  datums  look  like,  and  give  you  some  idea  of  what  the 
accuracy  is.  There  are  international  units  of  measure  in  geophysics  national 
reports  that  one  can  consult,  and  one  can  read  between  the  lines  and  see  for 
example  the  Peoples  Republic  of  China  has  a network  that  is  similar  to  ours  in 
terms  of  accuracy  or  you  can  obtain  it  from  the  geodetic  organizations  that 
are  inclined  to  make  that  information  available.  For  the  accuracies  that  we 
can  estimate  relative  between  two  points,  the  worst  that  you  can  find  is  1 in 
5,000.  That  is  due  to  the  instrumental  errors  because  you  are  dealing  with  an 
accuracy  only  from  one  point  to  another  2-3  miles  away.  However,  when  you 
look  at  these  in  terras  of  an  absolute  reference  (where  is  this  vis-a-vis  the 
geocenter?)  then  of  course  you  can  have  errors  as  high  200  meters.  Some  of 
the  datums  in  other  continents  are  much  weaker  in  terms  of  the  way  they  were 
constructed,  and  the  instr umentation  that  was  used,  so  you  may  very  well  get 
to  that  number. 

In  general,  if  one  get3  some  coordinates,  either  latitude  or  longitude  or  some 
other  types  of  coordinate  system  derived  from  latitude  and  longitude  any  place 
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on  the  Earth,  one  cannot  immediat<  assume  that  that's  part  of  the  same  coor- 
dinate system  that  we  have  in  the  U.S.  The  Doppler  Survey  System  today  is  al- 
lowing us  to  make  exact  determination  of  what  these  changes  and  what  the  er- 
rors actually  are.  An  example  of  this  problem  is  the  Universal  Transverse 
Mercator  projection.  The  UTM  coordinate  system  is  a way  to  represent  coordi- 
nates if  you  don't  want  to  deal  with  latitudes  and  longitudes.  Basically  the 
system  divides  the  Earth  up  into  sixty  zones  and  the  center  meridian  for  Zone 
1 is  at  longitude  180°  east.  The  scale  along  the  central  meridian  assumes  a 
false  easting  of  500,000.  Now  what's  important  is  that  this  is  not  a univer- 
sal transverse  Mercator  in  ar>  absolute  sense.  Its  universal  within  a particu- 
lar datum.  It  should  be  possible  to  compute,  if  you  know  the  information 
world-wide,  all  your  coordinates  and  put  all  them  into  one  datum,  a Geoscent- 
ric  Datum  and  then  you  can  transform  all  these  points  a given  projection. 
Then  you  have  indeed  a universal  Drojection.  All  of  this  is  done  by  the  mili- 
tary, but  I don't  know  of  an  inventory  of  coordinates  world-wide  that  is  con- 
sistent from  all  these  points  of  view.  The  problem  is  not  only  in  the  posi- 
tion of  the  mathematical  surfaces,  but  also  the  size  and  shape.  When  you 
bring  in  the  size  and  shape,  the  semimajor  axis  of  the  reference  elipsoid  and 
the  flattening,  you  get  just  as  many  combinations  of  datums;  there  are  hun- 
dreds of  datums  world-wide  each  of  which  look  at  the  problem  from  their  own 
point  of  view.  Basically,  the  characteristic  of  geodetic  control  is  that  it 
is  in  direct  proportion  to  the  technological  development  of  the  countries  in- 
volved [1,2].  World-wide  you  find  good  coverage  in  terms  of  geodetic  control 
in  the  U.S.,  in  western  Europe,  and  in  Japan.  You  find  less  than  full  cover- 
age even  in  the  Soviet  Union  and  South  America,  and  Asia  and  so  forth  in  other 
large  areas. 
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Figure  3.  North  American  Oatum  1946  Figure  4.  North  American  Datum  1981 
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Figure  5.  U.S.  Horizontal  Network 
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6.3  MAP  ACCURACY  REQUIREMENTS:  THE  CARTOGRAPHIC  POTENTIAL  OF  SATELLITE  IMAGE 

DATA* 

c> 

R.  Welch,  University  of  Georgia 

The  topic  of  this  presentation  is  map  accuracy  requirements.  I am  going  to  try 
to  relate  map  accuracy  requirements  to  the  cartographic  potential  of  satellite 
image  data.  The  objectives  are  to  consider, first, if  resolution  will  be  adequate 
for  the  identification  of  control  and  for  the  compilation  of  map  products.  Then, 
second,  to  define  map  accuracy  standards  and  to  determine  the  potential  for  meet- 
ing these  standards  with  image  data  from  the  film  camera,  scanner  and  linear 
array  systems  of  the  1980s. 

Cartographic  products  fall  into  a variety  of  classes.  We  have  topographic  maps 
that  are  concerned  with  planimetric  information  and  elevations  or  heights.  We 
have  thematic  maps,  which  might  be  used  for  geology,  vegetation,  water,  or  to 
display  these  subjects.  We  have  digital  elevation  maps  that  would  be  produced 
from  digital  terrain  data,  and  finally  we  have  image  maps.  In  terms  of  satellite 
applications,  we've  dealt  primarily  with  thematic  maps  and  with  image  maps,  and 
in  the  future  we  would  like  to  be  able  to  develop  some  digital  terrain  models 
and  topographic  map  products. 


Table  1 


EARTH  SATELLITE  PROGRAMS 

--1980s 

SATELLITE 

SENSOR 

IFOV 

SWATH 

Shuttle/Spacelab  (1982) 
Landsat-D  (1982) 

Film  Cameras  (LFC,  MC) 
Mechanical  Scanner 

5m* 

225  km 

(TM) 

30 

185 

SPOT  (1984) 

Line  Array  (HRV)** 

20 

60 

MOS  (1985) 

Line  Array  (MESSR) 

50 

200 

Stereosat  (?) 

Line  Array** 

15 

61 

Mapsat  (?) 

Line  Array** 

10- 3u 

185 

*Equivalent  I FOV 
**stereo 


We  would  like  to  be  able  to  develop  an  array  of  points  for  which  we  know 
the  X,  Y and  Z coordinates  and  then  interpolate  from  these  points  the  contours 
or  the  elections.  I might  point  out  that  the  accuracy  with  which  we  inter- 
polate may  be  a problem  here.  In  addition,  sensor  resolution  must  be  con- 
sidered. 

Table  1 summarizes  the  terrain  imaging  satellite  programs  for  the  1980s.  It 
is  important  to  note  the  Shuttle/Spacelab  film  cameras.  These  film  cameras 
have  an  equivalent  IFOV  of  about  5 m and  represent  to  baseline  against  which 
the  other  sensor  systems  will  have  to  be  compared. 

*Edi tecToral  presentation. 


215 


The  conventional  1:250,000  scale  map  contains  contours  and  considerable  plani- 
metric  detail.  One  can  see  the  outline  of  towns,  the  different  classes  of  roads, 
and  the  vegetation  patterns.  This  is  typical  of  a 1:250,000  scale  map  product. 
Now,  I'll  talk  about  well-defined  points.  By  well-defined  points  I mean  the 
intersection  of  roads  or  where  a bridge  crosses  a river,  things  of  this  nature. 
Well-defined  points  don't  exist  in  any  great  frequency  in  undeveloped  areas,  so 
this  is  a problem  if  we  are  going  to  extract  control  from  maps. 

With  the  Skylab  Earth  Terrain  camera  photograph  we  can  detect  the  highways,  the 
urban  development,  the  airfields  and  so  on.  This  is  about  the  best  resolution 
data  that  we've  had  to-date  and  is  representative  of  what  we  will  get  with  the 
Shuttle  cameras.  This  is  our  baseline  information.  How  good  a map  can  we  pre- 
pare with  an  approximate  equivalent  5 m IF0V?  Well,  we  can  prepare  quite  a good 
map  as  a matter-of-fact.  We  can  delineate  the  outlines  of  the  urban  areas,  we 
can  show  most  of  the  roads,  we  can  pick-up  the  vegetated  areas,  we  can  obtain 
quite  a bit  of  inf  rmation.  If  we  go  to  the  map  compiled  from  a RBV  image  of 
Landsat-3,  it  in  no  way  compares  to  a 1:250,000  scale  map,  nor  does  it  compare 
in  any  way  to  a map  which  was  compiled  from  the  Skylab  photography.  So  if  we're 
talking  about  Thematic  Mapper  data  which  may  be  of  slightly  better  resolution 
than  the  RBV,  it's  very  unlikely  that  we're  going  to  be  able  to  compile  maps  in 
the  traditional  sense  of  the  word. 

Now,  what  are  U.S.  National  Map  Accuracy  Standards  (NMAS,  Table  2)?  First  of 
all  we  can  divide  them  into  horizontal  and  vertical  accuracy  standards.  For 
horizontal  accuracy,  the  U.S.  standards  say  that  90%  of  well-defined  points 
should  be  plotted  at  the  map  scale  to  within  + 0.5  mm  of  the  correct  position. 
cor  example,  if  we  have  a map  scale  of  1:100,000,  the  bridges,  road  intersections, 
and  so  on,  must  be  correct  to  + 0.5  mm  on  the  map.  Thus,  we  can  say  that  90%  of 
the  points  must  be  within  + 0.5  mm  on  the  map  and  + 50  m on  the  ground.  For 
spot  heights,  90%  of  the  elevations  that  are  determined  from  contours  shall  be 
correct  to  within  cne-half  the  contour  interval.  Thus,  if  we  have  a contour 
interval  of  100  m,  ninety  percent  of  the  interpolated  elevations  should  be 
correct  to  within  + 50  m. 


Table  2 

U.S.  NATIONAL  MAP  ACCURACY  STANDARDS 

A.  HORIZONTAL  - 90%  OF  WELL-DEFINED  POINTS  SHALL  BE  PLOTTED  (AT  THE  MAP 
SCALE)  TO  WiTHIN  +0.5  mm  OF  THEIR  CORRECT  POSITION,  e.g., 

MAP  SCALE  = 1:100,000 
+ 0.5  mm  AT  MAF  SCALE  = + 50  m ON  GROUND 

THUS,  90%  OF  POINTS  MUST  BE  WITHIN  + 0.5  mm  ON  THE  MAF  AND  + 50  m ON  THE 
GROUND. 

B.  VERTICAL  - 90%  OF  THE  ELEVATIONS  DETERMINED  FROM  CONTOURS  SHALL  BE  CORRECT 
TO  WITHIN  1/2  THE  CONTOUR  INTERVAL  (C.I.),  e.g., 

C.I.  = 100  m 

THUS,  90%  OF  ELEVATIONS  REFERENCED  TO  CONTOURS  SHALL  BE  CORRECT  TO  WITHIN 
+ 50  m. 
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In  terms  of  horizontal  accuracy  now,  let  us  introduce  root  mean  square  error 
(RMSE).  By  RMSE  we  mean  that  58%  of  the  points  tested  lie  within  the  specified 
distance  from  the  correct  grid  coordinates  (Figure  1).  For  example,  if  the 
RMSE  is  + 15  m,  68%  of  the  points  tested  lie  within  + 15  m of  the  correct  loca- 
tion. For  the  90%  confidence  level  specified  by  NMAS,  we  must  multiply  15  m 
by  1.65  which  yields  + 25  m.  Next,  we  want  to  determine  the  largest  scale  map 
(which  is  really  what  we  want  to  know)  that  can  be  compiled  from  these  data 
and  still  meet  NMAS.  As  Figure  1 notes,  the  largest  scale  map  compatible  with 
horizontal  errors  of  + 25  m at  the  90%  level  of  confidence  is  1:50,000. 

Figure  2 reviews  vertical  accuracy  (Z).  If  the  RMSE^  is  + 15  m,that  means 
68%  are  to  be  within  that  value.  But  NMAS  state  that  90%  of  interpolated  Z-values 
must  be  correct  to  within  one-half  the  contour  interval.  So  statistically,  the 
closest  contour  interval  which  will  meet  NMAS  is  3.3  times  the  RMSE^,  or  50  m 
in  this  instance.  From  this  discussion  we  can  make  the  general  observation  that 
elevations  are  the  problem,  not  the  planimetric  positions. 

Figure  3a  notes  areas  of  the  world  with  poor  map  coverage,  and  it  is  precisely 
these  areas  where  satellite  data  are  going  to  be  most  useful.  These  are  also 
areas  that  have  poor  control  nets. 

Figure  3b  indicates  the  standard  contour  intervals  associated  with  maps  around 
the  world.  The  1:50,000  scale  maps  normally  have  a 20  m contour  interval.  The 
contour  intervals  found  on  1:100,000  scale  maps  range  from  20  to  50  m and  those 
on  1:250,000  maps  from  50  to  100  m.  If  you  are  going  to  talk  aDOut  compiling 
topographic  maps  at  these  scales,  you  have  got  to  be  able  to  meet  the  accuracy 
standards  for  elevations.  For  example,  with  a 1:100,000  scale  map.  planimetric 
accuracy  requirements  mean  + 50  m at  90%  or  + 30  m RMSE.  A 50  m contour  inter- 
val requires  an  RMSEZ  of  + 15  m. 

The  other  subject  which  we  have  to  consider  is  ground  control  and  I'd  like  to 
make  these  points.  First,  ground  control  is  normally  required  to  establish 
the  exterior  orientation  of  the  sensor  system.  Second,  ground  control  will 
consist  of  wel  1-defined  points  within  the  image  data  set  for  which  the  X,  Y,  Z 
terrain  coordinates  are  known.  Third,  most  ground  control  to  be  used  to 
rectify  satellite  image  data  will  be  obtained  from  existing  topographic  map 
bases.  Thus,  the  accuracy  of  the  source  maps  may  be  an  important  factor  (Table 
3).  Fourth,  in  the  absence  of  ground  control  there  must  be  an  external  means 
of  establishing  the  X,  Y,  Z coordinates  of  the  spacecraft  or  sensor  system:  e.g., 

orientation  data  from  a star  tracker  and  position  and  time  from  the  NAVSTAR 
GPS.  As  satellite  data  are  likely  to  prove  most  useful  for  mapping  areas  with 
poor  control,  the  external  means  of  dete  mining  spacecraft  position,  sensor 
attitude  and  time  are  extremely  important. 


Table  3 

ACCURACY  OF  GROUND  CONTROL  POINTS  OBTAINED 
FROM  MAPS  MEETING  NMAS 


SCALE  OF  MAP 

HORIZONTAL  RMSE 

CONTOUR  INTERVAL 

(C. I ,/3.3-C. 

1:250,000 

75  m 

100  m 

30-50  m 

1:200,000 

60 

100 

30-50 

1:100,000 

30 

50 

15-25 

1:50,000 

15 

20 

6-10 

1:25,000 

7.5 

10 

3-5 
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Future  sensors  will  employ  MLA  technology  in  which  a line  array  is  pushed  over 
the  earth  and  there  is  a time  element  involved.  You  are  not  recording  the 
entire  frame  at  one  instant  in  time.  You  are  recording  one  line  of  data  at  a 
time.  There  ere  several  sources  of  error  with  MLAs.  We  have  pointing,  atti- 
tude stability,  satellite  velocity,  measurement  precision  and  accuracy,  relia- 
bility of  ground  control,  earth  curvature  refraction,  processing  equipment, 
adjustment  procedures,  and  relief  dispTacement. 

Pointing  and  attitude  control  are  a major  problem.  If  we  are  going  to  map  we 
require  stereo  coverage,  and  most  of  the  stereo  systems  such  as  Mapsat  or 
Stereosat  are  going  to  take  coverage  with  a forward-looking  camera  and  with 
an  aft-looking  camera.  The  time  interval  between  the  fore-  and  the  aft-looking 
coverage  is  on  the  order  of  90  to  100  seconds  (B/H  = 1.0).  During  that  90- 
to  100-second  period,  the  attitude  of  the  spacecraft  has  to  be  very  stable. 

If  one  assumes  for  the  moment  that  we  have  a combined  error  due  to  pointing 
errors  and  attitude  errors  on  the  order  of  five  seconds  of  arc,  the  error  in 
X,Y  is  + TO  m and  the  Z error  is  going  to  be  about  + 20  m.  The  elevation 
component  is  the  critical  aspect,  and  attitude  control  is  absolutely  essential. 

A hypothetical  combination  of  errors  is  reviewed  in  Figure  4.  Given  the  assump- 
tion that  sensor  attitude  is  maintained  to  five  seconds  of  arc,  the  errors  in 
X,Y  and  in  Z are  about  + 10  m and  + 20  m respectively.  Let's  also  assume  we 
have  a measurement  or  correlation  error  equivalent  to  a half  of  a pixel.  That’s 
about  + 8 m.  Additional  miscellaneous  errors  may  equal  another  + 10  m.  If  we 
combine  these  errors  by  taking  the  square  root  of  the  sum  of  the  squares,  we 
obtain  +15  to  + 20  m for  planimetry,  and  about  + 25  m for  spot  heights.  The 
largest  scale  map  that  we  can  reproduce  from  such  data,  working  in  even  incre- 
ments, comes  out  to  about  1:100,000  scale  and  the  contour  interval  that  meets 
NMAS  is  on  the  order  of  100  m. 

In  conclusion  then,  I think  that  we  can  say  that,  first  of  all,  for  topographic 
mapping  at  scales  of  1:100,000  and  larger,  an  IF0V  of  10  m or  less  will  be 
required,  as  wi 1 1 geometric  accuracies  of  + 20  m or  better.  Secondly,  the  film 
cameras  to  be  employed  on  the  shuttle  missions  will  provide  baseline  data 
against  which  the  scanner,  line  array  and  radar  systems  can  be  evaluated.  Third, 
automated  mapping  will  require  error-free  image  data.  Thus,  in  my  opinion,  it 
appears  reasonable  to  emphasize  satellite  positioning  and  attitude  control  rather 
than  to  rely  solely  on  the  availability  of  dense  ground  control  and  on  costly 
image  processing  techniques  to  create  rectified  image  data  sets.  Finally,  sate- 
llite systems  which  provide  data  meeting  rigorous  topographic  mapping  require- 
ments will  also  satisfy  the  accuracy  requirements  for  thematic  mapping. 
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ROOT  MEAN  SQUARE  ERROR  (RMSE)  -68%  OF  POINTS  TESTED  LIE  WITHIN  THE  ^ECIFIED 
DISTANCE  WITH  REFERENCE  TO  THE  CORRECT  GRID  COORDINATES,  e.g., 

RMSE  = + 15  m 

THUS  68%  OF  THE  POINTS  TESTED  LIE  WITHIN  + 15  m OF  THl  CORRECT  LOCATION. 

FOR  A 90%  CONFIDENCE  LEVEL  AS  SPECIFIED  BY  NMAS,  IT  IS  NECESSARY  TO  MULTIPLY 
THE  RMSE  BY  1.65,  e.g., 

+ 15mxl.65  = + 25  m 

THUS,  THE  LARGEST  SCALE  MAP  WHICH  CAN  BE  COMPILED  AND  STILL  MEET  NMAS  IS: 

MAP  SCALE  FACTOR  = 

_ 25000  mm 
0.5  mm 

= 50,000 

FIGURE  1.  HORIZONTAL  ACCURACY  (X,Y) 


e.g.  RMSEZ  = + 15  m (68%) 

NMAS  STATE  90%  OF  ELEVATIONS  TO  + 1/2  C.I. 

STATISTICALLY, 

C.I. 

NMAS  = 3.3  x RMSE7 
= 3.3  x 15  L 
- 50  m 

THUS,  THE  CLOSEST  C.I.  WHICH  CAN  BE  COMPILED  TO  MEET  NMAS  IS  50  m 

FIGURE  2.  VERTICAL  ACCURACY 
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Figure  3a. 


Figure  3b. 
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The  shaded  areas  represent  countries  or  regions  with  50  percent  or 
less  of  their  area  mapped  at  1:100,000  scale  or  larger  in  1976 
(United  Nations,  1975). 


CONTOUR  INTtRVAi. 


Histograms  of  contour  intervals  for  topographic  maps  at  scales  of 
1:50,000,  1:100,000,  and  1:250,000  (United  Nations,  1976). 


SENSOR  ATTITUDE  - + 10  m IN  X,  Y 
(e.g.  5 tec)  + 20  m in  Z 

MEASUREMENT  ERROR  - +.1/2  PIXEL  (e.g.  + 8 m)  in  X,  Y,  Z 
MISCELLANEOUS  ERRORS  - + 10  m IN  X,  Y,  Z 

(DUE  TO  GROUND  CONTROL,  PROCESSING,  REFORMATTING,  RESAMPLING,  ADJUSTMENT 
PROCEDURES  ETC. 

RSMEv  v = VlO2  + 8^  + 102 
= + 1 5 - 20  m 

RSMEZ  = ^ 202  + 82  + 102 
= + 25  m 


MAPPING  CONSIDERATIONS 
MAP  SCALc  FACTOR^  Y 


C ' 1 ’ NMAS 


FIGURE  4.  COMBINATION  OF  ERRORS  (Based  on  H = 800  km,  IFOV  = 15  m) 


20  X 1.65 

O 

33  (000) 

0.5 

66.000  = 100,000 

= 3.3  X 25 
= 83  = 1 00  r. 
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6.4  MAP  PROJECTIONS  FOR  LARGER-SCALE  MAPPING* 


-ohn  P.  Snyder 
U.S.  Geological  Survey 
National  Center,  Stop  522 
Reston,  Virginia  22092 


ABSTRACT 

After  decaoes  of  using  a single  map  projection,  the  Polyconic,  for  its  nap- 
sing  program,  the  U.S.  Geological  Survey  now  uses  several  long-established 
(."ejections  for  its  published  maps,  both  large  and  snail  scale.  For  naps 
pc  1 :1 ,000,000-scale  and  larger,  the  most  common  projections  are  conformal, 
such  as  the  Transverse  Mercator  and  Lambert  Conformal  Conic.  Projections 
for  these  scales  should  treat  the  Earth  as  an  ellipsoid.  In  addition,  the 
'JSGS  has  conceived  and  designed  some  new  projections,  including  the  Space 
Oblique  Mercator,  the  first  map  projection  designed  to  permit  low-distortion 
mapping  of  the  Earth  from  satellite  imagery,  continuously  following  the 
groundtrack.  The  USGS  has  programmed  nearly  all  pertinent  projection  equations 
for  inverse  and  forward  calculations.  These  are  used  to  plot  maps  or  to 
transform  coordinates  from  one  projection  to  another.  The  USGS  is  also 
publishing  its  first  comprehensive  map  projection  manual,  describing  in 
detail  and  mathematically  all  projections  used  by  the  agency. 


INTRODUCTION 

The  U.S.  Geological  Survey  was  created  in  1879,  and  detailed  large-scale 
mapping  of  the  country  soon  became  one  of  its  primary  objectives.  It  has 
relied  heavily  over  the  years  on  the  former  U.S.  Coast  and  Geodetic  Survey 
(USC&GS,  now  the  National  Ocean  Survey)  ■''or  guidance  on  map  projections. 

Until  the  late  1950's,  only  the  Polyconic  projection  was  used  for  the  primary 
USGS  mapping  product,  i.e.,  large-scale  quadrangle  maps. 

The  Polyconic  projection  was  apparently  'nvented  and  certainly  promoted  by 
Ferdinand  Rudolph  Hassler,  the  first  head  of  what  was  to  become  known  as  the 
Coast  and  Geodetic  Survey.  In  the  1950‘s,  the  USGS  quadrangle  projection 
was  changed  to  the  Lambert  Conformal  Conic  and  the  Transve"se  Mercator  projec- 
tions, which  had  been  adopted  by  the  Coast  and  Geodetic  Survey  in  the  l°30's 
for  the  State  Plane  Coordinate  System.  The  development  of  standardized  zones 
based  upon  the  Universal  Transverse  Mercator  and  the  polar  Stereographic 
led  to  USGS  use  of  these  projections.  In  addition  to  these,  the  regular 
Mercator,  the  Oblique  Mercator,  the  Albers  Equal-Area  Conic,  and  the  Azimuthal 
Equidistant  have  been  used  for  other  larger-scale  mapping  by  the  US^S  and 
other  agencies.  Although  authors  and  organizations  variously  dfine  large- 


*Note:  This  paper  is  adapted  with  several  modifications  from  one  by  the  author 

published  in  the  Proceedings  of  the  1981  ACSM  Fall  Technical  Meeting. 


ORIGINAL  PA6S  IS 
OF  POOR  QUALITY 


and  intermediate-scale  mapping,  for  the  purposes  of  this  paper,  the  term 
"larger  scale"  will  apply  to  scales  larger  than  1 to  2 million. 

When  the  space  age  added  its  impact  to  mapping,  classical  projections  (Creator, 
Lambert  Conformal  Conic,  and  Stereographic)  were  chosen  for  the  napping  of 
the  Earth's  Moon,  three  other  planets,  and  a number  of  other  natural  satellites. 
Some  projections,  especially  the  Space  Oblique  Mercator,  originated  within  USGS 
to  assist  mapping  from  satellite  imagery. 


TYPES  OF  PROJECTION 

Before  describing  the  projections  themselves,  I'd  like  to  review  briefly  the 
different  types.  Equal-area  or  equivalent  projections  of  the  globe  are  used 
especially  by  geographers  seeking  to  compare  land  use,  densities,  and  the 
like.  On  an  equal-area  projection,  such  as  the  Albers  Equal-Area  Con^c, 
a coin  laid  on  one  part  of  the  map  covers  exactly  the  same  area  of  the  actual 
Earth  as  the  same  coin  on  any  other  part  of  the  map.  Shapes,  angles,  and 
scale  must  be  distorted  on  most  parts  of  such  a map,  but  there  are  usually 
certain  lines  on  an  equal -area  map  as  well  as  on  other  types  of  projections, 
along  which  there  is  no  distortion  of  any  kind.  These  so-called  "standard 
lines"  may  be  a meridian,  one  or  two  parallels,  lines  which  are  neither, 
or  not  a line  but  a point. 

More  commonly  used  in  larger-scale  napping  are  conformal  (orthonorphic) 
projections  such  as  the  Transverse  Mercator  and  the  Lambert  Conformal  Conic. 
The  term  means  that  they  are  correct  in  shape,  but,  unlike  the  term  "equal 
area,"  the  conformal  principle  applies  only  to  each  infinitesimal  element  of 
the  map.  Angles  at  each  point  are  correct,  and  consequently  the  local  scale 
in  every  direction  around  any  one  point  is  constant,  so  the  map  user  can 
measure  distance  and  direction  between  near  points  with  a minimum  o*  diffi- 
culty. Conformal  maps  may  also  be  prepared  by  fitting  together  small  pieces 
of  other  conformal  maps  which  have  been  enlarged  or  reduced;  non-conformal 
projections  require  reshaping  as  well.  When  the  region  consists  of  more 
than  a small  element,  distortion  in  shape  as  well  as  area  becomes  appreciable. 
This  is  especially  serious  with  the  most  famous  conformal  projection  — 
the  Mercator  — because  cf  its  widespread  use  in  classrooms,  especially 
in  the  past.  Because  there  is  no  angular  distortion,  all  merid^'-ss  intersect, 
parallels  at  right  angles  on  a conformal  projection,  just  as  the.,  do  on 
the  Earth.  "Standard  lines"  may  also  be  applied  to  a conformal  mup  to  elimi- 
nate scale  and  area  distortion  along  these  lines  and  to  minimize  distortion 
elsewhere. 

Some  map  projections,  such  as  the  Azimuthal  Equidistant,  are  neither  equal- 
area  nor  conformal,  but  linear  scale  is  correct  along  all  lines  radiating 
from  the  center,  along  meridians,  or  following  other  special  patterns.  In 
addition,  there  are  compromise  projections,  almost  entirely  restricted  to 
small-scale  mapping,  which  are  used  because  they  balance  distortion  in  scale, 
area,  and  shape. 
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Projections  are  often  classified  by  the  type  of  surface  onto  which  the  Earth 
may  be  mapped.  If  a cylinder  or  cone  that  has  been  placed  around  a globe 
is  unrolled,  we  have  the  concept  of  cylindrical  or  conic  projections, 
such  as  the  Mercator  or  Lambert  Conformal  Conic,  respectively.  If  the  axis 
of  the  cone  or  cylinder  coincides  with  the  polar  axis  of  the  globe,  the 
projection  has  equally  spaced  straight  meridians,  parallel  on  the  cylindrical 
projections  and  converging  on  the  conics.  The  parallels  intersect  the  meri- 
dians at  right  angles,  being  straight  on  the  cylindrical  and  concentric 
circular  arcs  on  the  conics.  The  spacing  of  the  parallels  is  seldom  projective. 
A plane  laid  tangent  to  the  globe  at  the  pole  leads  to  polar  aziirrthal  projec- 
tions, such  as  the  polar  Stereographic,  with  the  parallels  mapped  as  arcs 
of  concentric  circles  and  meridians  as  equally  spaced  rad’i  of  the  circles. 

Scale  remains  constant  along  each  parallel  of  latitude  on  a regular  cylindrical, 
conic,  or  polar  azimuthal  projection,  but  it  changes  *rom  one  latitude  to 
another.  Directions  of  all  points  are  correct  as  seen  from  the  center  of 
an  azimuthal  projection. 

If  the  cylinder  or  cone  is  secant  instead  of  tangent  to  the  globe,  the  projec- 
tion conceptually  has  two  lines  instead  of  one  which  are  true  to  scale. 

Wrapping  the  cylinder  about  a meridian  leads  to  transverse  projections.  Ry 
placing  a plane  tangent  to  the  Equator  instead  of  a pole,  equatorial  aspects 
of  azimuthal  projections  result.  Tilting  the  cylinder,  cone,  or  plane  to 
relate  to  another  point  on  the  Earth  leads  to  an  oblique  projection,  and  the 
meridians  and  parallels  are  no  longer  the  straight  lines  or  circular  arcs 
they  were  in  the  normal  aspect.  The  lines  of  constant  scale  are  correspond- 
ingly rotated. 


THE  EARTH  AN  ELLIPSOID 

Eor  maps  at  scales  smaller  than  1:5,000,000,  and  which  cover  regions  larger 
than  the  United  States,  the  distortions  from  mapping  the  spherical  Earth 
on  flat  paper  are  much  greater  than  the  slight  additional  corrections  needed 
to  compensate  for  the  ellipsoidal  shape  of  the  Earth.  These  corrections 
may  then  usually  be  ignored.  The  ellipsoid  should  be,  and  normally  is, 
used  for  large-scale  mapping  of  small  areas,  or  for  long  narrow  strips. 

Eor  such  areas,  the  flattening  of  the  round  Earth  usually  produces  less 
distortion  than  the  use  of  the  sphere  instead  of  the  ellipsoid. 

A shift  from  one  ellipsoid  to  another  has  a negligible  effect,  even  on  targe- 
scale  maps,  upon  the  projected  shapes  and  positions  of  meridians  and  parallels. 
A greater  effect  is  the  translation  of  latitude  and  longitude  for  all  points 
on  a map,  due  to  a change  in  datum,  that  changes  the  position  of  the  ellipsoid 
relative  to  the  Earth.  For  this  reason,  the  notation  in  the  corner  o+  USDS 
quadrangles  stating  "North  American  Datum  1927"  or  "1933"  is  as  important 
as  the  parameters  of  the  map  projection  in  defining  the  basis  of  these  maps. 

PRINCIPAL  PROJECTIONS 


Polyconic  Projection 

About  1870,  Hassler  began  to  promote  the  easily  constructed  Polyconic 
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projection  as  the  basis  of  large-scale  napping.  The  USfiS  used  this  projec- 
tion for  the  earliest  quadrangles,  only  changing  in  the  1950's  to  other 
projections,  although  relabeling  the  map  legend  lagged  considerably  behind 
the  change.  The  Polyconic  is  neither  equal-area  nor  conformal.  For  7-1/2- 
and  15-mi n.  quadrangles,  however,  the  distortion  is  negligible.  Along  the 
central  meridian,  it  is  free  of  distortion.  Each  parallel  is  also  true  to 
scale,  but  the  other  meridians  are  too  long,  and  constantly  change  scale. 

The  projection  is  not  recommended  for  maps  of  considerable  east-west  extent 
and,  in  fact,  should  not  be  seriously  used  for  any  new  maps  in  view  of  other 
projections  available. 

The  parallels  of  latitude  are  circular  arcs  spaced  at  their  true  distances 
along  the  central  meridian,  but  with  radii  equal  to  the  length  of  the  element 
of  a cone  tangent  at  the  particular  parallel.  The  projection  receives  its 
name  from  the  fact  that  each  cone  is  different.  Meridians  are  marked  on  each 
parallel  at  the  true  distances,  but  the  meridians  are  complex  curves  connecting 
these  points.  Lines  of  constant  scale  run  roughly  parallel  to  the  central 
meridian,  but  they  are  curved. 

Mercator  Projection 

The  Mercator  projection  is  the  most  v/ell  known  of  all.  It  was  presented  by 
Mercator  for  navigational  purposes  in  1569,  because  rhumb  lines,  or  lines  of 
constant  compass  bearings,  are  plotted  as  straight  lines.  This  is  still  the 
most  justifiable  use  of  the  projection  for  a map  of  regions  away  from  the 
Equator.  It  is  a normal  cylindrical  projection,  on  which  the  lines  of  constant 
scale  are  straight  and  run  parallel  to  the  Equator.  On  the  Mercator,  the 
scale  increases  away  from  the  Equator. 

The  USGS  has  used  the  Mercator  projection  for  maps  of  part  of  the  Pacific 
Ocean,  of  Indonesia,  and  for  portions  of  each  of  the  outer  bodies  mapped  to 
date,  from  our  Moon  to  the  satellites  of  Saturn.  In  some  cases,  the  chosen 
scale  applies  to  standard  parallels  placed  symmetrically  north  and  south  of 
the  Equator.  The  shape  of  the  nap  does  not  change.  The  scale  along  the 
Equator  could  still  be  called  correct  if  the  stated  scale  of  the  map  were 
slightly  decreased. 

Transverse  Mercator  Projection 

Rotating  the  cylinder  of  the  Mercator  so  that  it  lies  tangent,  (or  secant) 
alorj  a meridian  of  the  globe  leads  to  the  very  important  conformal  projec- 
tio’i  called  the  Transverse  Mercator.  The  central  meridian,  the  Equator,  and 
eac.i  meridian  90^  from  the  central  meridian  are  straight  lines.  All  other 
meridians  and  parallels  are  complex  curves.  For  the  sphere  and  normally  for 
the  ellipsoid,  the  central  meridian  has  a constant  scale,  but  this  is 
usually  reduced  from  the  nominal  map  scale  to  balance  errors  in  measurement 
over  the  rest  of  the  map.  The  lines  of  constant  scale  are  straight  lines 
parallel  to  the  central  meridian  for  the  sphere,  and  nearly  straight  for  the 
ellipsoid.  When  the  scale  factor  along  the  central  meridian  is  reduced,  the 
lines  of  true  scale  are  symmetrical  with  respect  to  the  central  meridian. 


228 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Lambert  presented  the  spherical  projection  in  1772,  but  Gauss  and  later  Kruger 
developed  the  mathematics  for  the  ellipsoidal  form.  The  projection  was  almost 
ignored  until  the  20th  century,  when  it  was  adopted  for  much  of  the  topographic 
mapping  in  Euronc  under  the  name  Gauss-Kruger,  and  in  the  United  States  for  the 
State  Plane  Coordinate  System  of  States  predominantly  north  and  south  in 
extent  and  for  the  Universal  Transverse  Mercator  or  UTM  projection  and  grid 
system.  The  UTM  has  two  special  restrictions:  (1)  The  central  scale  factor 
is  0.9996,  and  (2)  the  Earth  is  divided  into  sixty  zones,  each  6V  of 
longitude  wide,  with  the  central  meridians  placed  at  every  sixth  meridian 
beginning  with  the  177th  West.  (There  are  minor  exceptions.) 

When  USGS  stopped  using  the  Polyconic  projection  for  large-scale  quadrangle 
maps,  the  Transverse  Mercator  was  adopted  for  maps  of  areas  where  it  was 
used  for  the  State  Plane  Coordinate  System.  (Recent  metric  quadrangles  are 
based  upon  the  UTM).  In  the  State  Plane  Coordinate  System,  each  2one  follows 
county  boundaries  and  is  designed  to  restrict  scale  variation  over  the  map 
to  one  part  in  ten  thousand.  The  USGS  uses  the  predominant  zone  for  the 
projection  of  quadrangles  which  cross  county  boundaries.  The  central  scale 
reductions,  which  change  between  zones,  vary  from  1:160,000  to  1:10,000. 

Central  meridians  have  been  individually  selected  for  each  zone. 

Equations  in  series  form  are  used  for  the  Transverse  Mercator  calculations 
for  the  ellipsoid.  These  are  limited  to  a 6*  to  8°  band  of  longitude  and 
cannot  be  safely  extrapolated  for  use  over  a whole  continent.  Simpler  closed 
formulas  can  then  be  used  if  the  Earth  is  assumed  to  be  a sphere.  To  extend 
the  ellipsoidal  form  a greater  distance  from  the  central  meridian,  much 
more  complicated  formulas  are  available. 

When  USGS  converted  from  the  Polyconic  projection,  with  a central  meridian 
on  each  quadrangle,  to  the  State  Plane  Coordinate  System,  this  included 
employing  the  central  meridian  and  other  parameters  used  for  the  new  zone. 

The  discrepancies  in  measurements  on  the  Polyconic  and  the  Transverse  Creator 
forms  of  the  sane  7-1/2-  or  15  min.  quadrangle  depend  especially  upon  the 
distance  of  the  quadrangle  from  the  central  meridian  of  the  zone.  The  new 
quadrangles  can  be  mosaicked  for  the  entire  zone. 

The  1 : 250 ,000-scale  1x2  quadrangle  series  covering  49  of  the  States  was 
originally  to  be  cast  on  the  UTM.  When  the  Army  Map  Service  prepared  >.hese, 
the  UTM  central  scale  factor  of  0.9996  was  used,  but  the  central  meridian  of 
the  quadrangle  itself  was  used  in  place  of  that  of  the  UTM  zone.  These 
central  meridians  agree  with  those  of  the  UTM  zones  for  only  one-third  of 
the  quadrangles.  East-west  mosaicking  within  a UTM  zone  thus  cannot  be  achieved 
with  the  existing  maps,  which  are  now  being  updated  and  distributed  by  USGS. 

As  these  areas  are  remapped,  they  are  being  recast  with  the  UTM  central 
meridians. 

Oblique  Mercator  Projection 

A cylinder  may  be  placed  around  the  sphere  so  that  it  is  tangent  along  a great 
circle  which  is  neither  a meridian  nor  the  Equator.  In  this  case,  the  Oblique 
Mercator  may  be  conceptually  projected  for  conformal  mapping  of  a region  chiefly 
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extending  along  this  great  rircle.  Nearly  all  meridians  ?nd  parallels  are 
complex  curves-  Here  the  lines  of  constant  scale  run  parallel  to  the  oblique 
great  circle  path,  which  may  have  a reduced  scale.  Its  topographic  use 
by  USGS  is  confined  to  the  State  Plane  Coordinate  System  of  the  southeast 
extension  of  Alaska  and  to  the  mapping  of  Landsat  data  from  1978  to  the  present, 
prior  to  implementation  of  the  Space  Oblique  Mercator  projection  on  Landsat  0. 
There  are  several  ways  of  adapting  the  Oblique  Mercator  to  the  ellipsoid, 
although  none  is  ideal  because  either  the  central  line  does  not  remain  at  a 
precisely  constant  scale  or  conformality  is  not  precise.  Hotine's  adaptation, 
which  is  exactly  conformal,  is  used  in  these  USGS  applications. 

Space  Oblique  Mercator  Projection 

Among  the  more  complicated  projections  is  the  Space  Oblioue  Mercator, 
conceived  by  A.P.  Col vocoresses  of  USGS  in  1972  arc.  mawhematically  imple- 
mented in  1978.  It  is  ntended  specifically  for  .he  continuous  mapping  of 
imaging  from  satellites  such  as  Landsat  for  which  a rudimentary  form  was 
used  1975-1978.  The  more  accurate  form  is  to  be  used  for  Landsat  D.  The 
groundtrack  for  the  satellite  is  held  * •:  je  to  scale,  and  mapping  is  made 
basically  conformal.  Because  of  the  relative  motion  of  Earth  and  satellite, 
the  groundtrack  is  curved,  and  appears  almost  sinusoidal  on  the  map.  Formulas 
have  been  published  in  summu-'ized  form,  and  very  recently  with  detailed 
derivations  as  USGS  Bulletin  1518.  It  is  designed  for  use  with  the  ellipsoidal 
Earth,  and  with  circular  or  elliptical  satellite  orbits. 

Cassini  Projection 

A non-conformal  transverse  cylindrical  projection  called  the  Cassini  was 
used  for  British  topographic  mapping  until  about  .920,  when  it  began  to  be 
replaced  with  the  Transverse  Mercator.  On  the  Cassini,  scale  is  true  along 
the  central  meridian  and  along  lines  on  one  map  perpendicular  to  the  central 
meridian.  In  a direction  parallel  to  this  meridian,  scale  is  constant,  but 
it  is  increasingly  too  large  as  the  distance  from  the  meridian  increases. 

Thus  shane,  angles,  and  area  ore  distorted.  It  may  also  be  cast  obliquely. 

The  projection  was  used  for  Landsat  from  1972  to  1975,  but  is  hardly  used 
at  present. 

Lambert  Conformal  Conic  Projection 

Nearly  all  the  States  predominantly  east  and  west  in  extent  use  the  Lambert 
Conformal  Conic  as  the  projection  for  the  State  Plane  Coordinate  System. 

It  was  therefore  adopted  oy  USGS  for  post-1950  quadrangle  mapping  of  these 
areas.  This  projection,  presented  by  Lambert  in  1772,  maps  parallels  as 
concentric  circular  arcs  and  the  meridians  as  equally  spaced  radii  of  those 
circles.  One  pole  is  a*  t ho  center  of  the  circles,  while  the  other  pole  is 
at  infinity.  The  parallels  are  more  closely  spaced  K tween  the  normally 
two  standard  parallels,  which  have  no  distortion. 

For  the  USGS  map  of  the  conterminous  United  States,  the  standard  para.lels 
are  33°  and  45°  N. , and  USGS  has  made  bas^  maps  of  each  of  the  48  States  using 
these  standard  parallels  at  a scale  of  1:500,000.  The  base  maps  therefore 
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match  along  the  boundaries.  Each  zone  of  the  State  Plane  Coordinate  System 
has  its  own  standard  parallels.  These  are  the  parameters  used  for  (JSCS 
quadrangles  which  have  been  produced  on  this  projection;  thus,  quadrangles 
edge-match  within  the  zone. 

The  Lambert  is  also  used  for  the  nap  sheets  of  the  International  Map  o* 
the  World  series  at  a scale  of  1:1,000,000.  The  projection  for  these  sheets 
was  changed  from  a Modified  Polyconic  in  1962. 

Albers  Equal-Area  Conic  Projection 

The  Albers  Equal -Area  Conic  is  probably  seen  more  than  the  Lambert  Conformal 
Conic  as  the  projection  for  maps  of  the  United  States  and  its  larger  regions. 

In  1805,  Albers  showed  that  by  proper  spacing  of  the  parallels  on  a conic 
projection,  there  is  no  area  distortion,  and  along  one  or  two  standard  parallels 
there  is  no  scale  or  angular  distortion.  The  projection  was  nearly  dormant 
until  Oscar  S.  Adams  of  USC.V1S  began  encouraging  its  use  for  equal-area  maps 
of  the  United  States  in  the  early  part  of  the  20th  century. 

Adams's  tables  of  coordinates  for  the  48  States  are  based  upon  standard 
parallels  of  29-1/2°  and  45-1/2°  N.  It  should  be  noted  that  the  United 
States  on  the  Albers  projection  cannot  be  distinguished  from  a Lambert 
Conformal  Conic  version  if  the  projection  is  not  identified,  except  by 
careful  measurements.  Like  the  Lambert,  the  Albers,  which  is  the  equal-area 
counterpart,  has  concentric  arcs  of  circles  for  parallels,  and  equally  spaced 
radii  as  meridians.  The  parallels  are  not  equally  spaced,  but  they  are 
farthest  apart  in  the  latitudes  between  the  standard  parallels  and  closer 
together  to  the  north  and  south.  The  pole  is  not  at  the  center  of  the  circles, 
but  is  normally  an  arc  itself. 

Scale  along  any  given  parallel  is  constant,  as  on  the  Lambert,  with  scale 
too  small  between  the  standard  parallels,  and  too  large  beyond  them.  The 
scale  along  the  meridians  is  just  the  opposite,  to  maintain  equal  area. 

While  Adams  recommended  that  standard  parallels  be  placed  one-sixth  of  the 
displayed  length  of  the  central  meridian  from  the  northern  and  southern 
limits  of  the  map,  this  is  empirical.  The  standard  parallels  may  be  selected 
in  other  ways. 

Since  meridians  intersect  parallels  on  the  Albers  at  right  angles,  it  may  at 
first  be  thought  that  there  is  no  angular  distortion.  It  exists,  however, 
for  any  angle  other  than  that  between  the  meridian  and  parallel,  except  at 
the  standard  parallels. 

Stereographic  Projection 

For  larger-scale  maps  of  polar  regions,  the  Stereographic  projection  is 
commonly  used.  This  is  a perspective  projection  of  the  sphere  onto  a tangent 
or  secant  plane.  The  point  of  perspective  lies  on  the  opposite  side  of  the 
globe.  For  the  sphere,  the  Stereographic  is  both  perspective  and  conformal. 

For  the  ellipsoid,  it  may  be  one  or  the  other,  but  not  quite  both;  in 
practice,  it  is  used  conformal ly  in  every  case.  All  great  and  small 
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Albers  Equal -Area  Conic  Projection 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Polar  Stereographic  Projection 
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Obllq'ie  Stereographic  Projection 
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circles  on  the  sphere  are  shown  as  circles  or  straight  lines  on  the  map. 

This  includes  all  meridians  and  parallels. 

The  Stereographic  is  also  azimuthal,  and  lines  of  constant  scale  are  circles 
centered  on  the  projection  center.  In  the  polar  aspect,  a parallel  other 
than  the  pole  is  therefore  often  made  true  to  scale  to  balance  scale  varia- 
tion. The  USGS  has  used  the  projection  for  maps  of  the  entire  Antarctic 
continent  as  well  as  for  1 :250, 000-scale  quadrangles  of  portions.  It  is  also 
used  for  polar  portions  of  the  International  Map  of  the  World,  and  for  portions 
of  extraterrestrial  bodies  centered  at  the  poles  or  at  basins  elsewhere 
on  the  bodies. 

Azimuthal  Equidistant  Projection 

Familiar  to  many  air-age  atlas  users  is  an  azimuthal  projection  which  shows 
both  distances  and  directions  correctly  from  the  chosen  center  of  the  map, 
whether  the  North  Pole  or  a major  city.  Scale  in  other  directions  varies, 
and  is  too  great  except  at  the  center;  therefore  shape  and  area  are  distorted. 

In  addition  to  several  spherical  applications,  the  Azimuthal  Equidistant 
projection  has  been  used  in  the  ellipsoidal  form  for  the  Plane  Coordinate 
System  of  Micronesia,  for  which  each  major  island  provides  a center  for 
one  of  the  zones. 

Because  of  the  increasing  digitization  of  data  from  and  onto  many  different 
maps,  most  of  these  as  well  as  several  other  map  projections  have  been 
programmed  by  USGS  in  both  forward  and  inverse  form,  to  transform  geodetic 
coordinates  into  rectangular  coordinates,  and  vice  versa.  A bulletin  describing 
in  detail  ail  projections  which  have  been  used  by  USGS,  including  numerical 
examples  of  formulas,  is  soon  to  be  published.  We  hope  that  such  analyses 
of  both  the  past  usage  and  capabilities  of  map  projections  will  serve  the 
public  at  large  as  well  as  our  own  mapping  development. 
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7.0  PRESENTATIONS  ON  PROCESSING  AND  VERIFICATION 

7.1  SUMMARY 

For  each  working  group,  position  papers  were  given  to  survey  the  state  of  the 
art  in  applications  techniques  and  anticipated  requirements  and  focus  the 
workshop  discussion.  Three  papers  discussed  ways  to  improve  procedures  for 
identifying  and  matching  ground  control  points  (image  sharpness,  feature  ex- 
traction, inter-image  matching).  Three  papers  reviewed  the  procedures  and 
essential  elements  in  rectifying  images  for  registration  and  map  reprojection 
(photogrammetric  and  computational  aspects  of  remapping  and  resampling).  Two 
papers  used  case  studies  to  illustrate  the  complex,  multiple-component  charac- 
ter of  error  characterization/error  budget  analysis  and  verification  proce- 
dures used  for  spaceborne  imaging  sensor  systems. 
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7.2  A DISCUSSION  OF  IMAGE  SHARPNESS* 

Paul  Anuta,  Purdue  University 

There  has  been  a great  deal  of  work  done  on  image  sharpening,  image  filtering 
and  related  areas.  It  is  a very  large  field  of  activity  with  hundreds  of  ref- 
erences which  you  could  site  in  this  area.  The  image  sharpness  problem  can  be 
perceived  in  terms  of  the  block  diagram  in  Figure  1.  Basically  a scene  is 
viewed  by  a sensor,  and  the  sensor  has  some  sort  of  function  which  is  a non- 
point  observing  function.  It's  a function  that  gathers  energy  from  some  re- 
gion around  a point  in  the  scene.  That  energy  is  integratec  and  is  ccntribu- 
ted  to  each  point  or  each  sample  that  is  taken  of  the  scene.  The  samples 
become  the  pixels,  and  the  pixels  are  assembled  together  into  the  digital 
image.  Each  one  has  some  blurr  or  some  of  what  is  called  the  point's  spread 
function  creating  the  value  of  information  or  data  that  you  see  in  each  pixel. 
Then  the  sensor  and  electronic  part  of  the  system  acts  on  that  signal  out  of 
the  sensor  and  perhaps  adds  more  blurring,  more  loss  of  resolution  to  the  sys- 
tem. Finally,  sampling  and  quantization  of  the  data  produce  their  effects. 
You  sample  the  signal  at  some  rate  and  create  the  ditigal  image  from  that. 
The  sampling  or  digitizing  process  puts  the  continuous  voltage  or  whatever  you 
have  into  a number  of  discrete  binary  levels,  and  you  have  another  error  in- 
troduced there. 

After  quantization  you  end  up  with  the  digital  array  of  numbers  known  as  the 
remote  sensing  image.  It  should  be  noted  that  the  point  spread  function  of 
the  atmosphere  is  something  in  addition  that  causes  blurring  i the  image  at 
the  point  the  sensor  sees  it. 

The  terminology  of  the  imaging  process  often  creates  confusion.  Table  1 sum- 
marizes the  definitions  frequently  used.  The  only  term  or  function  that  I 
feel  comfortable  with  is  the  point  spread  function,  the  function  which  de- 
scribes what  an  infinitely  small  source  in  the  scene  would  look  like  in  the 
image.  The  image  is  spread  by  the  optics  and  by  the  other  effects  in  these 
systems  to  produce  the  final  image.  How  that  is  affected  by  the  system  is 
what  we  call  the  point  spread  function. 

The  point  spread  function  is  a two-dimensional  function  describing  how  a point 
is  blurred  in  the  scene.  The  IFOV  we  take  as  a number;  a single  number  tel- 
ling you  what  the  resolution  or  size  of  the  point  spread  function  is.  That 
can  be  any  functional  derivation  of  the  PSF  and  we  like  to  use  the  gaussian 
point  spread  function  due  to  the  mathematical  ease  of  applying  it,  and  we  feel 
it  relatively  well  expresses  the  imaging  system.  Effective  field  of  view  and 
resolution  field  of  view  is  something  to  be  discussed  in  the  panels  later  in 
trying  to  define  what  those  mean.  They  describe  the  imaging  aperture  asso- 
ciated with  the  imaging  process. 

The  point  spread  function  is  what  we  use  to  describe  what's  goin1  on  in  the 
imaging  process  and  that  can  include  the  filter-like  effects  of  the  sensor, 
actual  optical  effects,  and  perhaps  the  atmospheric  effects  also.  Right  along 
with  that  is  a function  called  the  modulation  transfer  function  which  is  the 
Fourier  transform  of  the  point  spread  function  (Figure  2).  It  is  the  fre- 
quency domain  representation  of  the  blur  properties  of  your  system.  That  is 
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what  you  seek  to  find  for  an  imaging  system.  It's  what  defines  the  sharpness, 
what  will  result  in  the  particular  image  sharpness  that  you  have,  and  the 
problem  then  is  to  figure  out  what  to  do  about  that.  Is  it  a satisfactory 
characteristic  for  your  system?  If  it  isn't,  what  do  you  do  to  compensate  for 
the  effects  of  that?  How  do  you  sharpen  the  image  that  you  have  other  than 
building  a whole  new  sensor  that  has  a sharper  optical  characteristic?  Can 
you  mathematically  process  the  imagery  to  improve  the  sharpness? 

Some  other  terms  are  shown  in  Figure  3;  these  include  the  edge  spread  func- 
tion, the  one-dimensional  version  of  the  point  spread  function  which  tells  you 
how  the  response  will  look  going  over  an  edge  in  one  direction  in  an  image. 
Then  there  is  the  term  resolution,  defined  as  the  number  of  black  and  white 
square  bars  that  can  be  discerned  from  a particular  unit  distance  in  an  image. 
Accoutance  is  another  term  I'm  not  familiar  with  but  related  to  the  slope  of 
the  edge  spread  function.  We  have  not  used  that  in  any  of  our  work. 

Defining  the  point  spread  function  or  the  sharpness  of  an  image  is  done  after 
the  system  is  built  and  in  the  platform.  That  is  a hard  job;  you  normally  do 
that  in  the  laboratory  by  special  test  panels,  scenes  that  you  use  to  evaluate 
the  system.  Once  it's  in  orbit,  trying  to  check  it  out  you  need  to  to  find 
optics  in  the  scene  that  will  simulate  line  or  point  sources  so  that  you  can 
measure  what  those  blurr  function  are.  You  usually  assume  separable  point 
spread  functions  so  that  lines  in  one  direction  or  another  can  be  used  to 
estimate  that  function.  If  it's  not  symmetric,  you  have  a problem  like  the 
computer-aided  tomography  problem  where  you're  trying  to  image  the  solid  by 
using  projections  and  you  have  to  define  lines  at  many  different  directions 
and  use  techniques  of  tomography  to  try  and  estimate  the  point  si  *ead  func- 
tion. 

One  can  look  at  an  image  as  a one-dimensional  sequence  of  stair-step  changes 
that  is  convolved  with  the  point  spread  function  in  the  imaging  process  as  * le 
sensor  scans  across  the  scene  and  produces  a smootn  or  blurred  version  of  the 
scene  (Figure  4).  The  idea  is  to  try  and  get  back  the  original  image  or  ori- 
ginal signal.  The  output  is  the  convolution  of  h,  the  point  spread  function 
and  the  image  called  x there.  It  would  appear  that  a simple  division  in  the 
frequency  domain  takes  the  Fourier  transform  of  these  functions.  This  becomes 
a simple  division  to  remove  the  effect  of  h and  you  would  get  x back.  But  it 
doesn't  work  out  that  easily.  There  are  noise  effects,  and  there's  the  prob- 
lem of  zero's  of  the  point  spread  function  in  the  frequency  domain  causing 
discontinous  points  in  the  solution.  And  it  turns  cut  to  be  a rather  tricky 
problem  to  try  and  do  this.  And  a great  deal  of  literature  is  in  existence  on 
attacking  this  problem. 

There  are  problems  with  the  i.  verse  in  that  as  1/h(f)  goes  to  zero,  you  have 
singularities,  you  find  ghosts  can  be  created,  artifacts  in  the  restored  image 
due  to  the  combination  of  these  problems  of  taking  the  inverse,  noise  effects 
and  quantization.  Quantization  can  amplify  the  effects  of  noise  and  there  is 
more  to  that  problem  than  initially  meets  the  eye.  Therefore,  we  form  a model 
that  describes  the  way  you  want  to  take  a look  at  the  problem  and  set  up  the 
mathematical  representation  of  the  model,  and  then  define  the  means  of  solving 
for  the  filter  you  want  which  would  be  here. 
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7.3  THE  DIGITAL  STEP  EDGE 


Robert  N . Haralick 

Oepartaents  of  Electrical  Engineering  and  Computer  Science 
Virginia  Polytechnic  Institute  and  State  University 
Blacksburg*  Virginia  24061 


Abstract 

We  use  the  facet  model  to  accomplish  step  edge  detection. 
The  essence  of  the  facet  model  is  that  any  analysis  ma^.e  on  the 
basis  of  the  pixel  values  in  some  neighborhood  has  its  final 
authoritative  interpretation  relative  to  the  underlying  grey  tone 
intensity  surface  of  which  the  neighborhood  pixel  values  are 
observed  noisy  samples. 

Pixels  which  are  part  of  regions  have  simple  grey  tone 
intensity  surfaces  over  their  areas.  Pixels  which  have  an  edge 
in  them  have  complex  grey  tone  intensity  surfaces  over  their 
areas*  Specifically.  an  edge  moves  through  a pixel  if  and  only 
if  there  is  some  point  in  the  pixel's  area  having  a zero  crossing 
of  the  second  directional  derivative  trken  in  the  direction  of  a 
non-zero  gradient  at  the  pixel's  center. 

To  determine  whether  or  not  a pixel  should  be  marked  as  a 
step  edge  pixel.  its  underlying  grey  tone  intensity  surface  must 
be  estimated  on  the  basis  of  the  pixels  *n  its  neighborhood.  For 
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this,  we  use  & functional  form  consisting  of  a linear  combination 
of  the  tensor  products  of  discrete  orthogonal  polynomials  of  up 
to  degree  thrse.  The  appropriate  directional  derivatives  are 
easily  computed  from  this  kind  of  a function. 

Upon  comparing  the  performance  of  this  zero  crossing  of 
second  directional  derivative  operator  with  Prewitt  gradient 
operator  and  the  Mar r-Eildr c th  zero  crossing  of  Laplacian 
operator,  we  find  that  it  is  the  best  performer  and  is  followed 
by  the  Prewitt  gradient  operator.  The  Mar r-Hildr e th  zero- 
crossing of  Laplacian  operator  performs  the  worst. 
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I . Introdnc t ion 

What  1$  an  edge  in  a digital  iaage?  The  first  intuitive 
notion  is  that  a digital  edge  occurs  on  the  boundary  between  two 
pixels  when  the  respective  brightness  values  of  the  two  pixels 
are  significantly  different*  Significantly  different  nay  depend 
upon  the  distribution  of  brightness  values  around  each  of  the 
pixels  * 

We  often  point  to  a region  on  an  iaage  and  say  this  region 
is  brighter  than  its  surrounding  area,  aeaning  that  the  neu  of 
the  brightness  values  of  pixels  inside  the  region  is  brighter 
than  the  aean  of  the  brightness  values  outside  the  region. 
Having  noticed  this  we  would  then  say  that  an  edge  exists  between 
each  pair  of  neighboring  pixels  where  one  pixel  is  inside  the 
brighter  region  and  the  other  is  outside  the  region.  Such  edges 
are  referred  to  as  step  edges. 

Step  edges  are  not  the  only  kind  of  edge.  If  we  scan 
through  U region  in  a left  right  aanner  observing  the  brightness 
values  steadily  increasing  and  then  after  a certain  point  observe 
that  the  brightness  values  are  steadily  decreasing  we  are  likely 
to  sav  th  there  is  an  edge  at  the  point  of  change  from 
increasing  to  decreasing  brightness  values.  Such  edges  are 
called  roof  edges. 

It  is,  therefore,  clear  from  our  use  of  the  word  edge  that 
edge  refers  to  places  in  the  image  where  there  appears  to  be  a 
jump  in  brightness  value  or  a local  extrema  in  brightness  value 
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derivative.  Jumps  in  brightness  values  are  the  hinds  of  edges 
originally  detected  by  Roberts  (1965).  Relative  extrema  of  first 
derivative  in  a one  dimensional  fora  is  used  by  Ehrich  and 
Schroeder  (1981)  and  in  an  isotropic  two-dimensional  suboptimal 
fora  by  Marr  and  Hildreth  (1980). 

In  soae  sense  this  suaaary  stateaent  about  edges  is  quite 

revealing  since  in  a discrete  array  of  brightness  values  there 

are  jumps,  in  the  literal  sense,  between  neighboring  brightness 

values  if  the  brightness  values  are  different,  even  if  only 

slightly  different.  Perhaps  aore  to  the  heart  of  the  matter, 

there  exists  no  definition  of  derivative  for  a discrete  array  of 

brightness  values.  The  only  way  to  interpret  jumps  in  value  or 

local  extrema  of  derivatives  when  referring  to  a discrete  array 

of  values  is  to  assume  that  the  discrete  array  of  values  comes 

about  as  soae  kind  of  sampling  of  a real-valued  function  defined 

2 

on  a bounded  and  connected  subset  of  the  real  plane  R . The 
jumps  in  value  or  extrema  in  derivative  really  must  refer  to 
points  of  high  first  derivative  of  f and  to  points  of  relative 
extrema  in  the  second  derivatives  of  f.  Edge  detection  must  then 
involve  fitting  a function  to  the  sample  values.  Prewitt  (1970), 
was  the  first  to  suggest  the  fitting  idea.  Heuckel  (1971,  1973), 
Brooks  (1978),  Haralick  (1980),  Haralick  and  Watson  (1981), 
Morgenthaler  and  Rosenfold  (1981),  Zucker  and  Hummel  (1979),  and 
Morgenthaler  (1981)  all  use  the  surface  fit  concept  in 
determining  edges. 
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Edge  finders  should  then  regard  the  digital  picture  function 
as  a sampling  of  the  underlying  function  f , where  some  kind  of 
random  noise  has  been  added  to  the  true  function  values.  To  do 
this,  the  edge  finder  must  assume  some  kind  of  parametric  form 
for  the  underlying  function  f,  use  the  sampled  brightness  values 
of  the  digital  picture  function  to  estimate  the  parameters,  and 
finally  mane  decisions  regarding  the  locations  of  discontinuities 
and  the  locations  of  relative  extrema  of  partial  derivatives 
based  on  the  estimated  values  of  the  parameters. 

Of  course,  it  is  impossible  to  determine  the  true  locations 
of  discontinuities  in  value  or  relative  extrema  in  derivatives 
directly  from  a sampling  of  the  functions.  The  locations  are 
estimated  by  function  approximation.  Sharp  discontinuities  can 
reveal  themselves  in  high  values  for  estimates  of  first  partial 
derivativos.  Relative  extrema  in  first  directional  derivative 
can  reveal  themselves  as  zero-crossings  of  the  second  directional 
derivative.  Thus,  if  ve  assume  that  the  first  and  second  partial 
derivatives  of  any  possible  underlying  image  function  have  known 
bounds,  then  any  estimated  first  or  second  order  partials  which 
exceed  these  known  bounds  must  be  due  to  uiscont inuities  in  value 
or  in  derivative  of  the  underlying  functfon.  This  is  basis  for 
the  gradient  magnitude  and  Laplacian  magnitude  edge  detectors. 
However,  edges  can  be  weak  but  well  localized.  Such  edges,  as 
well  as  the  strong  edges  just  discussed,  manifest  themselves  as 
local  extrema  of  the  ueriva  ve  taken  across  the  edge.  This  idea 
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for  edges  is  the  basis  of  the  edge  detector  discussed  here. 

In  this  paper,  ve  assume  that  in  each  neighborhood  of  the 
image  the  underlying  function  f takes  the  parametric  form  of  a 
polynomial  in  the  row  and  column  coordinates  and  that  the 
sampling  producing  the  digital  picture  function  is  a regular 
equal  interval  grid  sampling  of  the  square  plane  whicu  is  the 
domain  of  f.  As  just  mentioned,  we  place  edges  not  at  locations 
of  high  gradient,  but  at  locations  uf  spatial  gradient  maxima. 
More  precisely,  a pixel  is  marked  as  an  edge  pixel  if  in  the 
pixel's  immediate  area  there  is  a zero  crossing  of  the  second 
directional  derivative  taken  in  the  direction  of  the  gradient. 
Thus  this  kind  of  edge  detector  will  respond  to  weak  but 
spatially  peaked  gradients. 

The  underlying  functions  from  which  the  directional 
derviatives  are  computed  are  easy  to  represent  as  linear 
combinations  of  the  polynomials  in  any  polynomial  basis  set. 
That  polynomial  basis  set  which  permits  the  independent 
estimation  of  each  coefficient  would  be  the  easiest  to  use.  Such 
a polynomial  basis  set  is  the  discrete  orthogonal  polynomial 
basis  set . 

Section  II  discusses  the  polynomials.  In  section  II. 1 we 
discuss  how  to  construct  the  one  dimensional  family  of  discrete 
orthogonal  polynomials.  In  section  II. 2 we  discuss  how  arbitrary 
two  dimensional  polynomials  can  be  composed  as  linear 
combinations  of  the  tensor  products  of  one  t’  mens  ional  discrete 
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orthogonal  polynomials.  In  section  II. 3,  we  discuss  how  the 
discretely  sampled  data  values  are  use  to  estimate  the 
coefficients  of  the  linear  combinations;  coefficient  estimates 
for  exactly  fitting  or  estimates  for  least  square  fitting  are 
calculated  as  linear  combinations  of  the  sampled  data  values. 

Having  used  the  pixel  values  in  a neighborhood  to  estimate 
the  underlying  polynomial  function  we  can  now  determine  the  value 
of  the  partial  derivatives  at  any  location  in  the  neighborhood 
and  use  those  values  in  edge  finding.  Having  to  deal  with 
partials  in  both  the  row  and  column  directions  makes  using  these 
derivatives  a little  more  complicated  than  using  the  simple 
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II.  Xka  Bii&llil  fliXhitLgflJLl  E2liB-?"AjLi 

These  polynomials  are  sometimes  called  the  discrete 
Chebychev  polynomials  (Beckmann,  1973).  In  this  section  we  tf  * 
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how  to  construct  them  for  one  or  two  variables  end  how  to  use 
then  in  fitting  date. 

II. 1 BiJggSlft  flllJUlR&RAl  Polynomial  Conit£uqj:  i£B  TegkRigue 

Let  the  index  set  R be  symmetric  in  the  sense  that  reR 

implies  -reR.  Let  P (r)  be  the  nth  order  polynomial.  We 

& 

define  the  construction  technique  for  discrete  orthogonal 
polynomials  iteratively. 

Define  Pfl(r)  * 1. 

Suppose  Pg(r),...,  P ^(r)  have  been  defined  In  general, 
Pn(r)  * rn  + ar_^rn  * + ***  + 4lr  + a0‘  ^n^r^  ~ttst  b*  orthogonal 

to  each  polynomial  P^ { r ),..., Pn_j ( r ) . Hence,  we  must  i *ve  the  n 
equations 


5 

reR 


Pk(r) (r° 


+ 


+ 


+ a^r  + a^)  » 0,  k*0 


n-1  (1) 


These  equations  are  linear  equations  in  the  • .lki.own  a.,  ...a  , 

u n-x 

and  are  easily  solved  by  standard  techniques. 

The  first  five  polynomial  functions  formulas  are 
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p0(r)  - 1 


P^r)  * r 


p2(r)  « r2  - ^2/^0 


Pj(r)  * 


P4(r) 


f4  + (n2P4-»‘6)r2  + (,l2*l6“,142) 


where 


“k  - i ,i 

s cR 


II .2  Two  Dimens ional  Discrete  Orthogonal  Pv i ynomi i 1 r 

Two  dimensional  discrete  orthogonal  polynomials  can  be 
created  from  two  sets  of  one  dimensional  discrete  ortvogonal 
polynomials  by  taking  tensor  products.  Let  R anl.  C be  index  ~ets 
satisfying  the  symmetry  condition  rcR  implies  -rcR  and  ceC 
implie  -ceC.  Let  { PQ ( r ) , ♦ . • ( r ) } be  a set  of  discrete 

polynomials  on  R.  Let  CQQ  ( c Qj|(  c ) ) be  a set  of  discrete 

polynomials  on  C That  the  set 

( Pq ( r ) QQ ( c ( r ) Qm ( c )...*» ( r ) ( c ) } is  a set  of  discrete 
polynomials  on  RXC * 
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The  proof  of  this  fact  is  easy.  Consider 

is  orthogonal  to  P (r)Q  (c).  when  n ^ i or  m 

n m 


} } Pi(r)Qj(c)Pn(r)QB(c) 

reS  ceC 


= } Pi(r)Pa(r)  } Qj(c)Qn(c). 

rcR  ceC 


Since  n M or  a ^ j one  or  other  of  the  sums 


whether  (r>Qj (c) 
# j . Then 


must  be  zero . 
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Exaaplet : 


I ft  All  i£l  BllStAlS  OgthotQQll  PoLinggiAl  1«1 


{-1/2,  1/2}  {1. 

{-1.  0,  1)  {1, 

(-2/3,  -1/2.  1/2,  3/2}  {1. 

1-2,  -1,  0,  1.  2}  {1. 

r 


{-1  .0  ,1}  x {-1  ,0  ,1}  {i 


r} 

r,  r2  - 2/3} 

r.  r2  - 5/4,  r3  - 41/20r} 

r,  r2  - 2,  r3  - 17/5. 

-*•  3 r 2 + 72/35  } 

2 2 
,r  ,c  , r - 2/3  » rc  » c - 2/3 

i(c2  - 2/3)  . c ( r 2 - 2/3)  . 

(r2  - 2/3) (c2  - 2/3)  } 


Figure  1 and  2 show  some  of  the  window  nasks  used  for  the  3x3 
and  4 x 4 cases. 
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Figure  1 illustrates  the  > masks  xor  the  3x3  window 
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Figaro  2 illustrates  the  aiski  used  to  obtain  the  coefficients 
of  all  polynomials  up  to  the  quadratic  ones  for  a 4x4  window. 
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I I . 3 Fi t t ing  Data  With  Discrete  Orthogonal  Polynomials 

Let  an  index  set  E vith  the  symmetry  property  reR  implies 
-reR  be  given*  Let  the  number  of  elements  in  R be  N.  Using 
the  construction  technique,  we  may  construct  the  set 
(Pgtr) , • . * ,P^_^(r) } of  discrete  orthogonal  polynomials  over  R. 

For  each  reR,  let  a data  value  d(r)  be  observed.  The 
exact  fitting  problem  is  to  determine  coefficients  *Q,...,a^_^ 
such  that 

N~1 

d(r)  ~ 5 a P (r) 

im  n n 

n=0 

The  orthogonality  property  makes  the  determination  of  the 
coefficients  particularly  easy.  To  find  the  value  of  some 
coefficient,  say  i^,  multiply  both  sides  of  the  equation  by  P^Cr) 
and  then  the  sum  over  all  raR. 

N-l 

5*.  i », 

n*0  reR 

Hence  , 


} PB  (r)d(r) 
reR 


264 


£*«*.  PASS  IS 
u POOS  QUALITY 


*.  ' 1 Vt,d<t)  1 l rl(t)  (2> 

r«R  r*R 

Tha  approximate  fitting  problem  is  to  determine  coafficiants 
* 1 N_1  #ocl1  that 

K 

•2  - } Id(r)  - } .,P„(r>)2 
reR  n-G 

is  minimized.  To  find  the  value  of  some  coefficient*  say  a . 

m 

2 

take  the  partial  derivative  of  both  sides  of  the  equation  for  e 

vith  respect  to  a~.  Set  it  to  zero  and  use  the  orthogonality 

m 

property  to  find  that  again 

a.  - 5 P«(r)d(r)/  5 pj(t)  (3) 

m Am  m e*.  m 

rsR  reR 

The  exact  fitting  coefficients  and  the  least  squares  coefficients 
are  identical  for  m * 

Fitting  the  data  value;  {d(r)lreR)  to  the  polynomial 
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K 

Q(r)  “ 5 »nVr) 

n-0 

now  permits  ns  to  interpret  Q(r)  as  a well  behaved  real-valued 
function  defined  on  the  real  line*  To  determine 

dQ 


we  need  only  to  evaluate 


N 


- dP 

} an  7'(r0) 
dr 


n*0 


In  this  manner,  any  derivative  at  any  point  may  be  obtained. 
Similarly  for  any  definite  integrals.  Beaudet  (1978)  uses  this 
technique  for  estimating  derivatives  employed  in  rotationally 
invariant  image  operators. 

It  shonld  be  noted  that  the  kernel  used  to  estimate  a 
derivative  depends  on  the  neighborhood  size,  the  order  of  the 
fit,  and  the  basis  functions  used  for  the  fit.  Figure  3 
illustrates  one  example  of  the  difference  the  assumed  model 
makes.  This  difference  means  that  the  model  used  must  be 
justified,  the  justification  being  that  it  is  a good  fit  to  the 
data.  In  particular,  a not  sufficiently  good  justification  for 
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using  first  order  models  is  that  first  order  partial  derivatives 
are  being  estimated. 
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Assumed  Model 


g(r*c)“a00+a10r+a01c 


®{r*c)*  a00+a10r+a01c 
» + a20  ^ r^~^/3  ) +an  re  3) 

+ a21(r2-2/3)c  + a12(c2-  2/3)r 


Kernel  Mask  for  Row  Derivative 


+ + + + 

i-i  i-i  i-i  i 

+ + + + 

1/6  I 0 I 0 I 0 I 

+ + + 4- 

I 1 I 1 I 1 I 

+ + + + 


+ + + + 

I 0 1-1  I 0 I 

+ + + + 

1/2  I 0 | 0 I 0 I 

+ + + + 

I o I 1 ! o I 

+ + + + 


Figure  3 illustrates  that  the  assumed  model  does  make  a 
difference  in  the  kernel  mask  used  to  estimate  a quantity  such  as 
row  derivative. 
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III.  The  Directional  Derivative  Edge  Finder 

We  denote  the  directional  derivative  of  f at  the  point  (r#c) 
in  the  direction  a by  fa'(r,c).  It  is  defined  as 


f ( r+hsina, c+hcosa)  - f(r#c) 


f (r,c)  = lim { 4 ) 

a h->0  h 


The  direction  angle  a is  the  clockwise  angle  from  the  column 
axis.  It  follows  directly  from  this  definition  that 


9 

f (r,c)  “M(r,c)  sina  + <Lf(r,c)  cosa  (5) 

a 3 r 3 c 

We  denote  the  second  directional  derivative  of  f at  the 

9 9 

point  (r,c)  in  the  direction  a by  f (r,c)  and  it  quickly 
follows  that 


,,  3 f*ia 
f * — - 
° ar2 

2a  + 

2 2 2 

23  fsina  cosa  + 3 fcos  a 

2 

3rc  3c 

(6) 

Taking 

f to 

be  a cubic  polynomial  in 

r and  c 

which  can  be 

estimated 

by 

the  discrete  orthogonal 

polynomial 

fitting 

procedure , 

we 

can  compute  the  gradient  of 

f and 

the 

gradient 
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direction  angle  at  the  center  of  the  neighborhood  used  t^ 
estimate  f.  Letting  f be  estimated  as  a two  dimensional  cubi 


f (r,c) 


“ kl  + k2r  + k3° 

+ k^r2  + k^rc  + k^c2 

+ k^r2  + kgr^c  + k^rc2 


+ k10c 


3 


(7) 


we  obtain  a by 

sina  - k,/(k  2 + k 2) *5 

\ % a (8) 

coso  - k3/<k2  + k3  } 

At  any  point  (r,c),  the  second  directional  derivative  in  the 
direction  a is  given  by 


f ( r , c ) 
a 


2 2 
(6k,y  sin  a + 4kg  sinacosa  + 2k^  c >s  a)r  (9) 

2 2 
+ (tk^  co*  a + ^^9  cosa  + 2kg  sin  a)c 

2 2 
+ (2k^  sin  a + 2k^  sina  cosa  ♦ 2k^  cos  a) 


We  wish  to  only  consider  points  (r,c)  on  the  line  in 
direction  a.  Hence,  r»psina  and  c*pcosa.  Then 
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fa  (p) 


3 2 

6[k^sin  a + k^sin  a cosa 

2 3 

+ kgsiaa  cos  a + k^cos  a]p 
2 


(10) 


2„  . . 3 

a + k^cos  < 

2 2 
+ 2 [ k ^ sin  a + kj  sina  cosa  + k^  cos  a] 


Ap  + B 


ii  * * 1 

If  for  some  p,  1 p I < pA,  f (p)  “ 0 and  f (p)  i1  0 »e  have 

u a a 

discovered  & zero-crossing  of  the  second  directional  derivative 
taken  in  the  direction  of  the  gradient  and  ve  mark  the  center 
pixel  of  the  neighborhood  as  an  edge  pixel. 


IV.  Statistical  Analvs is 

In  this  section  we  show  how  the  randomness  of  the  noise 
induces  a randomness  in  the  least  squares  coefficients  and  then 
how  the  randomness  of  the  least  squares  coefficients  induces  a 
randomness  in  the  estimated  gradient  value,  the  estimated  angle 
of  the  gradient,  and  the  estimated  location  of  the  zero-crossing. 


IV. 1 General  Model 

Ve  let  p , n«l,...,N  denote  the  names  of  the  discrete 

n 

orthonormal  basis  functions,  q denote  the  independent  and 
identically  distributed  noise,  and  g denote  the  gray  tone 
intensity  function.  Dnuer  this  model,  the  observed  image  can  be 
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written  as 


N 

g(r,c)  * J an  Pn ( r # c ) + n(r,c) 
n*l 


(11) 


where 


J pn(r,c)  Pm(r.c) 
r , c 


[0 , n#m 
1 n*m 


and  the  least  squares  estimates  ,aj(j  for  the  unknown 

coefficients  a^#  t , . ,iflare  given  by 


for 


an  “ 5 *(r'c)  Pn(*,c) 
r , c 

Substituting  the  formula  for  g(r,c)  into 
a^  an/,  simplifying  results  in 

* an+  ^ Pn(r,c)  n(r,c) 


(12) 


the  equation 


(13) 


r , c 

clcarl}  showing  that  a^  has  a de termi>  i 7 1 ic  part  and  a random 

part,  the  randomness  being  due  to  the  noise.  Ve  assume  that  the 

2 

noise  is  independent  normal  having  mean  0 and  variance  o • 

Therefore,  the  estimated  coefficient  a1  has  mean  a , variance 

n n 

2 

o and  is  uncorrelattd  with  every  other  coefficient: 
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E l*;i  * »« 

& & 

E i«;  a;i  - a,an»  a * a 

E [a'2]  * a2  + <T2 
ii  n 

V u;i-  «2 

The  residual  error  e is  defined  as  the  difference  between 
the  observed  values  and  fitted  values.  It  too  is  a random 
variable . 

N 

e(r,c)  * g(r,c)  ^ a^  pn(r,c)  (14) 

n=l 


N 

“ Y (an~  Pn<r,c)  + n(*.c) 
n=l 

It  is  not  difficult  to  see  that  at  each  lr,c),  the  residual  error 

has  mean  rero  and  is  nncorrelated  with  each  estimated  coefficient 

a'  since 
n 

E la'  e ( r > c ) ] - 0 

n 

After  some  algebraic  substitutions  and  a.anipul at  ion * the  total 

2 

residual  error*  S * can  be  written  as 
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N 

S2  » J « 2 ( r , c ) - J tj2  ( r , c ) - J (»n~  *^)2  (15) 

r,c  r, c n“ 1 

Thus,  if  the  noise  is  assuaed  noraal  and  there  are  K pixels  in  a 
window 


J H2<*»c)/  o2  has  X2, 
r , c 

a chi-squared  variate  with.  K degree  of  freedom. 


N 

l »•«  *S 

n*l 

r 2 2 

which  maxes  2 « (r,c)  have 

r , c 


IV. 2 Esllma t ina  the  First  Part  ills 

If  the  discrete  orthogonal  basis  functions  are  polynomials 
then  each  first  partial  derivative  at  (0P0)  in  the  row  and  column 
directions  is  given  as  some  linear  combination  of  the  estimated 
coefficients.  Furthermore,  tne  linear  combination  for  the  row 
partial  will  be  orthogonal  to  the  linear  combination  in  the 
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column  partial.  Lotting  the  coefficients  of  the  linear 

combination  for  the  row  partial  be  and  the  coefficients 

of  the  linear  combination  for  the  column  partial  be 
where 


N N 


n- 1 n»l 


we  have, 

N 

•*r  " 1 an  *n 
n*l 

N 

“c  - 1 ‘n  *n 
11*1 

as  the  true  but  unknown  values  of  the  row  and  column  part  ills . 
The  estimates  are 


275 


OF  POOR  QUAUiY 

N 

K " } *n  •; 

n^l 

N 

**;  * 1 tn »; 
n*l 

and  they  have  aean  and  variance  given  by 

e u;i  - Hr 
E u;j  nc 

V [4;]  - o2k 

V [4']  - o2k 

E f |i # p ' I * 11  u 

rrhc  *r  Hc 

Hence*  the  estimates  for  the  rov  and  column  partial  derivatives 
are  unco r r e 1 a ted . 
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j / . 3 Hypo  the  sis  Te  s t inn  For  Zero  Gradient 

To  see  the  effect  of  the  randomness  on  the  estimate  of 
the  gradient  magnitude,  consider  testing  the  hypothesis  that 
- uc  * 0.  This  hypothesis  must  be  rejected  if  there  is 
o be  a zero-crossing  of  second  directional  derivative,  Under 
his  hypothesis. 


2 

has  a distribution. 

The  total  residual  error  normalized  by  the  noise  variance, 

2 <)  2 

Sx/o*,  has  a distribution.  Hence 

+ |l ' ^ ) / 2 

i V 

k S2/(K-N) 

h.ts  a f,  distribution  and  the  hypothesis  of  = 0 

would  be  rejected  for  suitably  large  values. 

I V . 4 nfidence  Interval  for  Grad  ient  Direction 

To  see  the  effect  of  the  randomness  on  the  estimate  of  the 
direction  of  the  gradient,  consider  the  relationships  portrayed 
in  figure  The  axes  are  the  row  and  column  partials  y f and 

. The  direction  angle  0 of  the  gradient  is  given  by 
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cos  e * nr/ < »s^  + p2)1'2 
sin  e * nc/(nj  + p2)1/2 


(16) 


The  center  of  the  circle  is  at  the  estimate  ( n ' , p * ) . Upon 

r c 

substituting  the  estimates  1 19  and  |i  * for  |i  and  p , we 

r c r c 

obtain  the  estimated  direction  angle  6*  by 


ccs  e*  - i»;/(h,2+  ;»,2)1/2 
sin  e'  - p;/<ji'2*  p,2)1/2 


(17) 


From  a Bayesian  point  of  view,  the  area  of  the  circle 

represents  the  conditional  probability  that  the  unknown 

(|t  .u  ) lies  within  a distance  R from  the  observed 
r c 

< ja  * , p,  * ) given  that  the  variance  of  ji  ' and  \i*  is  known 
r c r e 

2 

and  equal  to  ko  . Assuming  a normal  distribution  for  the 

2 2 

noise,  this  conditional  probability  is  q = 1-c  R ° Hence, 
if  probability  q is  given,  the  corresponding  radius  R is 


k o [-2  log(l-q)] 


1/2 


(18) 


To  determine  a confidence  interval  for  0 of  the  form 
0 * - A^  0 ^0 9 + A,  we  have  from  figure  4 that 


sin  A * 


h a (-2  log(l-q)) 
r r * c 


(19) 
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Note  that  the  2A  confidence  interval  length  depends  on  the 

probability  q of  the  circle  confidence  region  for  ( p , \i  ) 

r c 

2 2 

and  the  unknown  noise  variance  a . Although  a is  not 

2 2 2 

known,  we  do  know  S which  has  a a I distribution.  We  can 

2 

handle  the  problem  of  the  unknown  o by  determining  a joint 

2 

confidence  region  for  (p  ) and  o ( Font  i , 1 9 81 ) * Taking 

r c 

p to  be  the  probability  that  a chi-squared  random  variable  with 

2 

a-N  degrees  of  freedom  has  an  observed  value  greater  than  I _ „ 

a-N  • p 

2 * 2 

we  have  the  confidence  interval  [0,  S /X*_  w ] for  a having 

L-N  , p 

2 

at  least  probability  p.  Replacing  a in  equation  (19) 

2 2 

by  S /X  M - we  obtain 
n-k  , p 


sin2A 


k S*(-2 


I2 

2'N.p 


log ( 1-q) ) 

+ *H*> 


(20) 


A confidence  interval  for  6 having  at  least  probability  pq  is  then 
(6*-  A,  «'+  A) . 
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Figure  4 illustrates  the  geometry  of  the  confidence  interval 
estimation  for  the  edge  angle* 
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IV. 5 Edge  Hypo  the  sis  Testing 

In  this  section  ve  first  take  the  edge  direction  a to  be  a 
fixed  constant.  Ve  let  and  |ig  be  the  expected  values  of 
the  random  variables  A and  B appearing  in  equation  (10).  The 
null  hypothesis  is  that  an  edge  exists.  The  null  hypothesis  is 
satisfied  if  for  some  p,  o £ p <,  d,  ti  p + pn  * 0 . 

The  observed  random  variables  are  A,  B,  and  the  residual 
fitting  error  S~.  The  bivariate  random  variable 


A 

B 


is  normal  having  mean 


co var i ance 


where  k^  and  kg  are  known  constants.  For  a window  of  K pixels 

2 2 2 

and  a cubic  fit,  S la  has  a 

From  this  it  follows  that 


Z(*W 


l(A-nA)/kA]2  + [<B-nB/kB2n/2 
S2/ (K-10) 


has  an  distribution. 

We  define  R * {(x,y)lfor  some  p,  o ^ p ^ d,  xp  + y * 

0}  Then  the  null  hypothesis  is  rejected  at  the  p significance 
level  if 


mm 


^ ^A*  ® R 


z(»*a  *P 


A*HBJ 


is  larger  than  F2  K_1Q 
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An  edge  strength  probability  can  be  defined  by  q where  q 
satisfies 


■ in 

UA.*B>« 


Z(|iA.HB) 


F2  k-10  q 


Of  course  the  edge  direction  a is  not  fixed.  But  we  do 
have  a confidence  interval  for  it.  And  for  each  value  of  a in 
the  confidence  interval,  the  random  variable  A(a)  and  B(a) 
can  be  computed  and  the  null  hypothesis  tested.  If  for  all  a 
in  the  confidence  interval  the  null  hypothesis  is  rejected,  then 
the  existence  of  an  edge  is  also  rejected. 

In  practice,  we  can  perform  a non-exact  hypothesis  test 
selecting  only  the  left  end,  middle,  and  right  end  values  of  a 
from  its  confidence  interval.  If  for  each  of  these  three  values 
of  a the  null  hypothesis  is  rejected,  then  the  existence  of  an 
edge  is  also  rejected. 


V.  Experimental  Results 

To  understand  the  performance  of  the  second  directional 
derivative  zero-crossing  digital  step  edge  operator  we  examine 
its  behavior  on  a well  structured  simulated  data  set  and  on  a 
real  aerial  image.  For  the  simulated  data  set,  we  use  a 100x100 
pixel  image  oi  a checkerboard,  the  checks  being  20x20  pixels. 
The  dark  checks  have  gray  tone  intensity  75  and  the  light  checks 
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have  gray  tone  intensity  175*  To  this  perfect  checkerboard  we 
add  independent  Gaussian  noise  having  mean  zero  and  standard 
deviation  50.  Defining  the  signal  to  noise  ratio  as  10  times  the 
logarithm  of  the  range  of  signal  divided  by  RMS  of  the  noise,  the 
simulated  image  has  a 3 db  signal  to  noise  ratio*  The  perfect 
and  noisy  checkerboards  are  shown  in  figure  5, 

Section  V*1  illustrates  the  performance  ot  the  classic  3x3 
edge  operators  with  and  without  pteaver&ging  compared  against  the 
generalized  Prewitt  operator.  Section  V,2  illustrates  the 
performance  of  the  Mat r-Hildr e th  zero-crossing  of  Laplacian 
operator,  the  11x11  Prewitt  operator,  and  the  11x11  zero-crossing 
of  second  directional  derivative  operator*  The  zero-crossing  of 
second  directional  derivative  surpasses  the  performance  of  the 
other  two  on  the  twofold  basis  of  probability  of  correct 
assignment  and  error  distance  which  is  defined  as  the  average 
distance  to  closest  true  edge  pixel  of  pixels  which  are  assigned 
non-edge  but  which  are  true  edge  pixels. 

V . 1 The.  Classic  Edge  Operators 

The  classic  3x3  gradient  operators  all  perform  badly  as 
shown  in  figure  6.  Note  that  the  usual  definition  of  the  Roberts 
operator  has  been  modified  in  the  natural  way  so  that  it  uses  a 
3x3  mask. 

Averaging  before  the  application  of  the  gradient  operator  is 
considered  to  be  the  cure  for  such  bad  performance  on  noisy 
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Figure  5 illustrates  the  noisy  checkerboard  used  in 
experiments.  Low  intensity  is  75  high  intensity  is 

Standard  deviation  of  noise  is  50. 
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images  (Rosenfeld  and  Kak,  1976),  Figure  6 also  shows  the  same 
operators  applied  after  a box  filtering  with  a 3x3,  5x5,  and  7x7 
neighborhood  sizes. 

An  alternative  to  the  preaveraging  i to  define  the  gradient 
operator  with  a larger  w dow.  This  is  easily  done  with  the 
Prewitt  operator  ( Pr ew i t t , 1 97 0 ) which  fits  a quadratic  surface  in 
every  window  and  uses  the  square  root  of  the  sum  of  the  squares 
of  tl  coefficients  of  the  linear  terms  to  estimate  the  gradient, 
(A  linear  fit  actually  yields  the  same  result  for  the  polynomial 
basic  function.  A cubic  fit  is  the  first  higher  order  fit  which 
would  yield  a different  result.)  This  is  illustrated  in  figure 
7.  A 3x3  pre-average  followed  by  a 3x3  gradient  operator  yields 
a resulting  neighborhood  size  of  5x5.  Thus  in  figure  7 we  also 
show  the  3x3  preaverage  followed  by  a 3x3  gradient  under  the  5x5 
Prewitt  and  we  show  the  5x5  pre-average  followed  by  the  3x3 
gradient  under  the  7x7  Prewitt.  The  noise  is  higher  in  the  pre- 
average edge-detector . For  comparison  purposes  the  5x5  Nevatia 
and  Babu  (1979)  compass  operator  is  shown  alongside  the  55 
Prewitt  in  figure  8.  They  give  virtually  the  same  result.  The 
Prewitt  operator  has  the  advantage  of  requiring  half  the 
comput a t i o n . 

It  is  obvious  from  these  results  that  good  gradient 
operators  must  have  larger  neighborhood  sizes  than  3x3. 
Dn fortunately,  the  larger  neighborhood  sizes  also  yield  thicker 
edges 
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Figure  7 illustrates  the  Prewitt:  Operator  dors»  by  using  & 
squares  quadratic  fit  in  the  neighborhood  versus 
pre averaging  and  using  a siiller  fitting  neighborhood  size, 
no  preaveraging  results  show  slightly  higher  contrast. 
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Figure  % coo  pa  res  the  Nevatia  and  Baba  compass  operi»f 
Prewitt  operator  is  a 5x5  neighborhood. 
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To  detect  edges,  the  gradient  value  must  be  thresholded.  In 
each  case,  we  chose  a threshold  value  which  makes  the  conditional 
probability  of  assigning  an  edge  given  that  there  is  an  edge 
equal  to  the  conditional  probability  of  there  being  a true  edge 
given  that  an  edge  is  assigned.  True  edges  are  established  by 
defining  them  to  be  the  two  pixel  wide  region  in  which  each  pixel 
neighbors  some  pixel  having  a value  differert  from  it  on  the 
perfect  checkerboard.  Figure  9 shows  the  thresholded  Prewitt 
operator  (quadratic  fit)  for  a variety  of  neighborhood  sizes. 
Notice  that  because  the  gradient  is  zero  at  the  saddle  points 
(the  corner  where  four  checks  meet),  any  operator  depending  on 
the  gradient  to  detect  an  edge  will  have  trouble  there. 


V . 2 The  Second  Derivat ive  Zero  Cross  i n & Ed  & e Operators 

Marr  and  Cildreth  (1980)  suggest  an  edge  operator  based  on 
the  zero  crossing  of  a generalized  Lapltcian.  In  effect,  this  is 
non- directional  or  isotropic  second  derivative  zero  crossing 
operator.  The  mask  for  this  generalized  Laplacian  operator  is 


at  row  colum  coordinates  (r,c)  designating  the  center  of  each 
pi^el  position  in  the  neighborhood  and  then  setting  the  value  k 
so  that  the  sum  of  the  resulting  weights  is  zero.  Edges  arc 
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Figure  9 illustrates  the  edges  obtained  by  thresholding  the 
results  of  the  Prewitt  operator. 
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detected  at  all  pixels  whose  generalized  Laplacian  value  is  of 
one  sign  and  one  of  whose  neighbors  has  a generalized  Laplacian 
value  of  the  opposite  sign.  A zero-crossing  threshold  strength 
can  be  introduced  here  by  insisting  that  the  difference  between 
the  positive  value  and  the  negative  value  oust  exceed  the 
threshold  value  before  the  pixel  is  declared  to  be  an  pixel. 

Figure  10  illustrates  the  edge  images  produced  by  this  technique 
for  a variety  of  threshold  values  and  a variety  of  values  for  a 
for  an  11  by  11  window.  It  is  apparent  that  if  all  edge  pixels 
are  to  be  detected,  there  will  be  many  pixels  declared  to  be  edge 
pixels  which  are  really  net  edge  pixels.  And  if  there  are  to  be 
uo  pixels  which  are  to  be  declared  edge  pixels  which  are  not  edg 
pixels,  then  there  will  be  many  edge  pixels  which  are  not 
detected.  Its  performance  is  poorer  than  the  Prewitt  operator. 

The  directional  second  derivative  zero  crossing  edge 
operator  introduced  in  this  paper  is  shown  in  figure  11  for  a 
variety  of  gradient  threshold  values.  If  the  gradient  exceeds 
the  threshold  value  and  a zero-crossing  occurs  in  a direction  of 
+ 14.9  degrees  of  the  gradient  direction  within  a circle  of  one 
pixel  length  centered  in  the  pixel,  then  the  pixel  is  declared  to 
be  an  edge  pixel.  This  technique  performs  the  worst  at  the 

saddle  points,  the  corner  where  four  checks  meet  because  of  these 
being  a zero  gradient  there. 

Table  1 shows  the  comparison  among  the  Prewitt  operator  and 
the  directional  and  the  Ma r r-fli 1 dr e th  non-direct  ional  second 
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Figure  10  illustrates 
Hildreth  zero-crossing 
different  zero- crossing 
deviations  for  the  associated  Mexican  hut 


e edges  obtained  by  the  llx 
of  Laplac i an  operator  set  f 
thresholds  and  three  different 

filter. 


Figure  11  illustrates  the  directional  derivative  edge  operator 
for  4 different  thresholds* 
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derivative  zero  crossing  edge  operators.  The  threshold  used  is, 
as  before,  the  one  equalizing  the  conditional  probability  of 
assigned  edge  given  true  edge  and  the  conditional  probability  of 
true  edge  given  assigned  edge*  It  is  clear  that  the  performance 
of  the  directional  derivative  operator  is  better  than  the  Prewitt 
operator  and  the  Mar r-H i 1 dr e t h operator,  both  on  the  basis  of  the 
correct  assignment  probability  and  the  error  distance  which  is 
the  average  distance  to  closest  true  edge  pixels  of  pixels  which 
are  assigned  non-edge  labels  but  which  are  true  edge  pixels* 

Figure  12  shows  the  corresponding  edge  images  of  the  11x11 
Prewitt  operator  using  a cubic  fit  rather  than  a quadratic  fit, 
the  11x11  Marr-Hildr e th  operator,  and  the  11x11  directional 
derivative  zero-crossing  operator.  The  thresholds  used  are  the 
ones  to  equalize  the  conditional  probabilities  as  given  in  Table 
1.  A visual  evaluation  also  leaves  the  impression  that  the 
directional  derivative  operator  produces  better  edge  continuity 
and  has  less  noise  than  the  other  two. 
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For  the  case  of  constant  variance  additive  noise, 
thresholding  on  the  basis  of  the  hypothesis  test  of  section  IV. 3 
yields  essentially  the  same  results  as  simply  thresholding  the 
gradient  value. 

Figure  13  illustrates  the  second  directional  derivative  zero 
crossing  operator  on  an  aerial  image  which  has  been  median 
filtered  and  then  enhanced  by  replacing  each  pixel  with  the 
closer  of  its  3x3  neighborhood  minimum  or  maximum.  The  technique 
is  so  good  that  it  is  possible  to  determine  region  boundaries 
essentially  by  doing  a connected  components  on  non-edge  pixels. 
Figure  13b  shows  the  cleaned  edge  image  which  is  obtained  by 
doing  a connected  components  on  tl_e  non  edge  pixels,  then 
removing  all  pixels  whose  region  has  fewer  than  20  pixels.  The 
resulting  boundaries  are  given  as  pixels  which  have  a neighbor 
with  a different  label  than  its  own. 

Initial  raw  edges  which  leave  gaps  in  a region  boundary  will 
in  effect  make  the  regions  merge  in  the  connected  components 
step.  Thus  the  small  number  of  missing  boundaries  is  surprising. 
To  be  sure,  we  are  not  advocating  connected  components  as  an 
image  segmentation  technique.  The  fact  that  it  works  as  well  as 
it  does  is  an  indication  of  the  strength  of  the  edge  detector. 
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Figure  13b  illustrates  the  directional  derivative  edges  obtained 
from  the  aerial  photograph  by  first  3x?  median  filtering,  then 
replacing  each  pixel  by  the  closer  of  its  3x3  neighborhood  minimum 
or  maximum,  then  taking  tue  directional  derivative  edges  using  a 
7x  ' window,  then  doing  a connected  components  on  the  non-edge 
pixels,  and  removing  all  regions  having  fewer  than  20  pixels,  and 
then  displaying  any  pixel  neighboring  a pixel  different  than  it 
is  an  edge  pixel. 
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Prewitt 

Marr-Hildreth 

Directional  Derivative 

Parameters 

Gradient 

Threshold  * 18.5 

Zero-crossing 
Strength  * 4.0 
<i  - 5.0 

Grad  ient 
Thr e shold  = 14 . 0 
p * . 5 

P(AE|TE) 

.6738 

.3977 

.7207 

P(TElAE) 

.6872 

.4159 

.7197 

Error  Distance  1.79 

1.76 

1.16 

Table  1 compares  the  performance  of  three  edge  operators  using  an 
11x11  vindov  on  the  noisy  checkerboard  image.  Thresholds  are  chosen 
to  equalize!  as  best  as  possible,  P(AE|TE),  the  conditional 
probability  of  assigned  edge  given  true  edge  and  the  conditional 
probability,  P(TElAE)  of  true  edge  given  assigned  edge.  The  error 
distance  is  the  average  distance  to  closest  true  edge  pixels  of  pixels 
which  are  assigned  non-edge  but  which  are  true  edge. 


ORIGINAL  r :V  >' 

OF  PCOF.  QU.V- 


VI-  Cone  las  ions 

We  have  argued  that  numeric  digital  image  operations  should 
be  explained  in  terms  of  their  actions  on  the  underlying  gray 
tone  intensity  surface  of  which  the  digital  image  is  an  observed 
noisy  sample.  We  called  this  model,  the  facet  model  for  digital 
image  processing  and  showed  how  the  facet  model  can  be  used  to 
estimate  in  each  neighborhood  the  underlying  gray  tone  intensity 
surface  . 

We  described  a digital  step  edge  operator  which  detects 
edges  at  all  pixels  whose  estimated  second  directional  derivative 
taken  in  the  direction  of  the  gradient  has  a zero  crossing  within 
the  pixel's  area.  We  discussed  the  statistical  analysis  of  *.his 
technique,  illustrating  how  to  determine  confiaence  intervals  for 
the  direction  of  the  gradient  and  how  this  - 1 determin  s a 
confidence  interval  fox  the  placement  of  the  rerc-crossing 

X e have  compared  the  performance  of  the  directional 
derivative  zero  crossing  edge  operator  with  that  of  the  classic 
edge  operators,  the  generalized  Prewitt  gradient  operator,  and 
the  Ma r r-H i 1 H r e t h zero  crossing  edge  operator.  We  found  that  in 
both  the  simulated  and  real  image  data  sets  the  directional 
derivative  zero  crossing  cdje  operator  had  superior  performance. 


Ve 

have  illustrated 

that  for 

good 

performance  it 

i s 

important 

to  use 

larger  neighborhood 

sizes 

than  3xi 

and 

have 

shown  that  better 

results 

are  achieved  by 

de  f ining 

the 

edge 

operator 

na  tur  a 1 ly 

in  the 

large  neighborhood 

rather 

than 

pre- 
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averaging  and  then  using  a smaller  neighborhood  edge  operator  on 
the  averaged  image. 

There  is  much  work  yet  to  be  done.  We  need  to  explore  the 
relationship  of  basis  function  kind,  (polynomial,  trignometric 
polynomial  etc.),  order  of  fit,  and  neighborhood  size  to  the 
goodness  of  fit.  Evaluation  must  be  made  of  the  confidence 
intervals  produced  by  the  technique.  The  technique  needs  to  be 
generalized  so  that  it  vorks  on  saddle  points  created  by  two 
edges  crossing.  A suitable  edge  linking  method  needs  to  be 
developed  which  uses  these  confidence  intervals.  Ways  of 
incorporating  semantic  information  and  ways  of  using  variable 
resolution  need  to  be  developed.  An  analogous  technique  for  roof 
edges  needs  to  be  developed.  We  hope  to  explore  these  issues  in 
f utur e paper s . 
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FOREWORD 


This  paper  was  invited  to  provide  a review  of  the  portion  of  the  registra- 
tion process  relating  to  determining  relative  positions  of  reference  and  regis- 
trant images  at  a set  of  locations  within  the  images  and  embodiment  of  those 
positions  in  a ref erence-to-registrant  mapping  function.  There  was  an  unfor- 
tunately short  time  available  between  request  and  conference  date,  and  as  a 
result  the  review  is  not  as  thorough  as  the  authors  would  have  liked  to  have 
given.  Ve  are  most  familiar  with  the  processing  of  earth  observations  from 
Landsat,  and  have  concentrated  our  review  on  the  processing  of  Landsat  data  by 
the  Master  Data  Processor  (MDP)  at  the  Goddard  Space  Flight  Center  (GSFC),  the 
registration  processor  installed  at  the  Johnson  Space  Center  (JSC),  the  regis- 
tration process  used  in  the  DAM  (detection  and  mapping)  Package  in  conjunction 
with  a Corps  of  Engineers  project  to  map  surface  water,  the  registration  process 
used  by  the  LACIE  processor  et  GSFC,  and  the  sequential  similarity  detection 
algorithm  (SSDA)  used  by  IBM/Houston  in  the  evaluation  of  the  LACIE  processor 
imagery.  Our  review  slights  the  body  of  information  available  from  military 
research,  in  which  shape  recognition  and  artificial  intelligence  play  a promi- 
nent part.  In  that  field,  there  is  interest  in  finding  objects  that  have 
changed  position  with  respect  to  a fixed  background,  or  monitoring  changes  in 
aspect  for  guidance,  and  there  is  often  limited  interest  in  spectral  develop- 
ment. (Xir  own  field  of  concentration  involves  images  in  which  considerable 
spectral  development  has  taken  place  (observations  are  made  throughout  a crop 
year  for  agricultural  applications),  although  for  the  mo^t  part  the  scene's 
basic  geometrical  shape  is  unchanged.  To  some  extent  field  boundaries  change 
from  year  to  year,  but  this  is  usually  a small  enough  effect  so  as  not  to  inter- 
fere with  the  registration  process.  In  the  presence  of  spectral  development, 
one  does  not  ordinarily  correlate  bet_ween  images  on  the  radiance  measurement 
making  up  the  parent  image,  but  instead  relies  on  a derivative  feature  (in  our 
case,  edges)  that  one  hopes  will  be  stable  despite  spectral  development.  We 
defer  the  discussion  of  extracted  feature  selection  to  other  papers  being  pre- 
sented at  this  workshop,  noting  in  passing  that  we  are  most  familiar  with  the 
edge-detection  algorithm  implemented  in  both  the  MD?  and  the  JSC  registration 
processor.  This  paper  further  concentrates  on  automated  interimage  correlation; 
the  manual  techniques  involved  in  the  DAM  Package  and  other  systems  are  a funda- 
mentally different  technology.  First,  of  course,  the  points  of  correspondence 
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between  images  are  manually  determined.  Second,  the  interpretation  is  normally 
done  on  radiance  images  transformed  into  visual  presentations.  And  finally, 
the  manual  techniques  are  typically  done  on  a point  basis  with  only  contextual 
involvement  of  the  neighborhood  around  the  point  designated  as  being  in 
correspondence.  In  the  image  comparisons  discussed  in  this  paper,  measures 
of  similarity  are  made  over  areal  extents  of  subsets  of  the  parent  images,  as 
opposed  to  points. 
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Introduction 


Interimage  matching  is  the  process  of  determining  the  geometric  trans- 
formation required  to  conform  spatially  one  image  to  another.  In  principle, 
the  parameters  of  that  transformation  are  varied  until  some  measure  of  "differ- 
ence" between  the  two  images  is  minimized  or  some  measure  of  "sameness"  (e.g., 
cross-correlation)  is  maximized.  The  number  of  such  parameters  to  vary  is 
fairly  large  (six  for  merely  an  affine  transformation),  and  it  is  customary 
to  attempt  an  a priori  transformation  reducing  the  complexity  of  the  residual 
transformation  or  subdivide  the  image  into  small  enough  match  zones  (control 
points  or  patches)  that  a simple  transformation  (e.g.,  pure  translation)  is 
applicable,  yet  large  enough  to  facilitate  matching.  In  the  latter  case,  a 
more  complex  mapping  function  is  fit  to  the  results  (e.g.,  translation  offsets) 
in  all  the  patches.  The  methods  reviewed  have  all  chosen  one  or  both  of  the 
above  options,  ranging  from  an  a priori  along-line  correction  for  line-dependent 
effects  (the  ,fhigh-f  requency  correction")  to  a full  sensor-to-geobase  trans- 
formation with  subsequent  subdivision  into  a grid  of  match  points. 

There  is,  of  course,  a correct  geometric  transformation  to  apply,  but  it 
is  unknown  (otherwise,  an  empirical  image  matching  process  would  be  unnecessary); 
thus,  some  sort  of  model  must  be  assumed  whose  parameters  can  be  solved  for  by 
correlation  of  offset-fitting.  Commonly,  a portion  of  the  geometric  model  is 
established  a priori  based  on  external  data  such  as  preflight  measurements.  If 
that  portion  is  incorporated  in  an  a priori  transformation,  then  the  demand  for 
fidelity  in  the  overall  model  becomes  an  issue  of  tradeoffs  between  the  a priori 
geometric  correction  and  the  residual  correction  to  be  determined  by  matching. 

For  example,  if  one  know  the  geometric  transformation  is  affine  with  an  unknown 
translation,  one  might  let  the  image  matching  function  solve  for  the  whole 
affine  transformation,  risking  the  introduction  of  errors  into  the  affine  co- 
efficients, or  apply  the  affine  transf ormat ion  a priori  and  solve  only  for  trans- 
lation. Thus,  in  addressing  the  various  parts  of  image  matching  in  the  following 
sections,  we  must  also  consider  their  interaction  with  portions  of  the  overall 
geometric  correction  process  which  otherwise  might  be  regarded  as  beyond  the 
scope  of  this  paper.  The  utility  of  an  a priori  transformat  ion  is  also  mani- 
fested in  another  way.  Data  gathered  from  prior  registrations  can  be  used  to 
bias  the  a priori  correction.  Such  "experience"  data  might  be  gathered  by 
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analyzing  ensembles  of  prior  registrations  such  as  associated  acquisitions 
(different  dates,  same  scene)  or  associated  geometry  (e.g.,  different  subscenes, 
same  frame) . Such  experience  data  are  then  included  in  the  data  base. 

The  following  sections  logically  divide,  according  to  the  above  precepts, 
into  (1)  a consideration  of  correlation  techniques,  (2)  examination  of  other 
matching  methods,  (3)  a discussion  of  determining  the  translational  offset  from 
the  correlation,  (A)  a consideration  of  the  residual  geometric  model  and  how  to 
determine  it,  and  (5)  a summary  of  techniques  going  beyond  the  assumption  implicit 
in  the  previous  sections  that  match  points  have  been  established  to  allow  correla- 
tion for  translational  offsets  only.  Throughout  these  discussion;  we  make  refer- 
ence to  the  registration  processor  recently  installed  at  JSC,  note  experimental 
results  pertaining  to  that  system  as  appropriate,  and  note  general  limitations 
and  areas  deserving  further  study. 

Image  Correlation 

Suppose  that  an  a priori  correction  has  been  applied  or  patches  are  defined 
small  enough  that  any  residual  geometric  error  worthy  of  consideration  is  pure 
translation.  Matching,  then,  consists  of  determining  the  translat ional  offset  of 
one  subimage  from  another  "reference"  subimage  corresponding  to  the  same  scene. 

The  most  common  form  of  matching  is  some  sort  of  cross-correlation  technique. 

The  "image"  referred  to  is  the  actual  radiance  image  or  a feature-space  image 
such  as  an  edge  or  gradient  image.  In  principle  the  cross-correlation  of  two 
acquisitions  of  the  same  scene  should  resemble  the  autocorrelat ion  displaced  by 
the  same  amount  as  one  image  from  the  other.  Since  the  peak  of  the  autocorrela- 
tion function  must  occur  at  the  origin,  the  peak  of  the  idealized  cross-correlation 
then  measures  the  displacement.  Iu  practice,  the  acquisitions  differ  because  o l 
instrument,  atmosphere,  and  other  environmental  noise  and  because  the  scene  may 
have  changed  appearance  due  to  seasonal,  weather,  or  cultural  changes.  Thus, 
the  cross-correlat ion  only  approximates  the  autocorrelation,  and  the  peak  may 
not  be  well-defined.  Another  argument  for  the  cross-correlation  peak  measure 
is  that  it  minimizes  the  sum-square-difference  between  the  two  images.  This 
measure  of  cross-correlation  can  be  normalized  (to  be  between  -1  aid  1)  by  two 
techniques  summarized  in  Figure  1.  The  "template  matching"^  alternative  utilizes 
only  the  pixel  values  from  the  search  area,  whereas  the  "classical"  alternative 
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utilizes  both  images.  The  pixel  values  indicated  are  after  subtraction  of  the 
image  means.  For  binary  edge  images,  whose  pixel  values  are  either  0 or  1, 
rigor  fails  in  the  following  sense.  Strictly  speaking,  the  means  of  the  0's 
and  l*s  should  be  subtracted  before  summing;  however,  considerable  gain  in 
computation  speed  is  achieved  if  the  coincidences  and  numbers  of  l's  are 
summed  directly. 

The  correlation  techniques  just  described  are  employed  in  several  produc- 

2 3 

tion  registration  systems.  The  Master  Data  Processor  (MDP)  * , the  GSFC  baseline 

system  for  Landsats  2 and  3,  basically  performs  the  "classical"  cross-correlation 

on  the  radiance  image.  As  a functional  equivalent,  Fourier  techniques  are  used; 

that  is,  the  reference  and  search  areas  are  transformed  by  the  standard  FFT 

algorithm,  one  of  the  transforms  is  multiplied  by  the  complex  conjugate  of  the 

other,  and  the  result  is  inverse-transformed  by  FFT.  A slight  variance  is 

effected  in  the  denominator  by  subtracting  the  local  mean  (mean  over  portion  of 

search  area  overlay ed  by  reference)  from  the  search  area's  pixels,  rather  than 

the  mean  of  the  whole  search  area.  The  latter  is  used  in  the  numerator  in  con- 

4 

formance  with  the  classical  formula.  The  GSFC  LACIE  Registration  Processor 
employed  the  template  matching  algorithm  on  binary  edge  images,  and  the  same 
scheme  was  used  in  an  evaluation  of  that  processor."*  Both  classical  and  template 
matching  algorithms  are  provided  for  binary  edge  correlation  in  the  JSC  Regis- 
tration Processor The  classical  option  has  been  chosen  for  production 
processing . 

The  matching  policy  discussed  above  is  based  on  minimizing  the  sum-square- 

g 

difference.  The  sequential  similarity  detection  algorithm  (SSDA)  is  based  on 

minimizing  the  sum-absolute-difference.  However,  rather  than  summing  over  all 

pixels,  the  SSDA  selects  at  random  a subset  of  pixels  to  sum.  Summing  stops 

when  a present  threshold  is  reached,  and  the  number  of  pixels  needed  for  that 

sum  is  noted.  Then,  the  correlation  maximum  occurs  at  the  same  point  as  the 

maximum  of  the  numbers  of  pixels  required  (because  the  sum-absolute-difference 

is  smallest  there  requiring  the  most  pixels  to  reach  the  threshold).  The  utility 

of  the  SSDA  lies  in  its  reduction  in  computation  by  utilizing  only  partial  sums 

whose  computational  rigor  is  less,  the  smaller  the  correlation  is.  Thus,  the 

bulk  of  the  computation  is  devoted  to  correlation  samples  showing  promise  with 

9 

little  effort  wasted  on  low  values.  The  SSDA  was  also  used  this  time  on  the 
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radiance  images,  in  the  performance  evaluation  of  the  GSFC  LACIE  Registration 
Processor.  The  correlation  was  normalized  by  dividing  the  pixels  of  each  image 
by  their  standard  deviation  before  correlating* 

The  design  of  the  SSDA  illustrates  a primary  concern  in  standard  cross- 
correlation,  viz  diminishing  the  number  of  required  computations.  In  general, 
methods  to  address  that  issue  have  focused  on  devoting  the  bulk  of  the  computa- 
tions to  the  region  around  the  appropriate  extremum.  Such  a method,  well-suited 

4 

to  binary  edge  correlation,  was  used  in  the  GSFC  LACIE  Registration  Processor 
and  for  coarse  acquisition  in  the  JSC  Registration  Processor.  First,  cross- 
correlation is  done  only  for  offsets  every  fourth  row  and  every  eighth  column. 

The  mean  and  standard  deviation  of  the  results  are  computed,  and  thrice  the 
latter  is  added  to  the  former  to  generate  a rejection  threshold.  Next,  an 
approximate  correlation  is  computed  at  every  offset  but  with  only  pixel  values 
from  every  third  row  and  third  column  included  in  the  sums  in  Figure  1 (thereby 
reducing  the  computation  by  about  a factor  of  nine).  If,  at  a given  displace- 
ment, the  resulting  approximate  correlation  value  exceeds  the  rejection  threshold, 
the  sums  are  repeated  using  every  pixel  value.  In  binary  edge  correlation  the 
peak  is  generally  fairly  sharp,  and  only  a very  small  fraction  of  the  correla- 
tion samples  exceed  the  threshold,  thereby  sparing  a considerable  amount  of 
computation.  Inis  method,  used  for  a segment-level  correlation  (8x10  km  por- 
tion of  a Landsat  MSS  frame),  proved  very  effective  in  the  GSFC  and  JSC  Processors. 

The  foregoing  discussion  assumes  the  geometric  difference  between  the  com- 
pared patches  is  pure  translation.  This  assumption  may  not  be  valid,  which 
raises  the  question  of  how  geometric  distortion  (other  than  translation)  affects 
the  cross-correlation  function.  The  effect  has  been  studied  for  standard  cross- 
correlation (i.e.,  for  minimizing  the  sum  square  ’ifference)  where  one  patch  is 
distorted  linearly  (rotation,  scale  change,  shear  distortion)  from  the  other. 

The  results  indicate  that  linear  distortion  effectively  blurs  the  cross-correlation 
function  by  applying  a running  average  over  the  ideai  nondistorted  counterpart, 
where  the  dimensions  of  the  averaging  filter  are  proportional  to  the  degree  of 
distortion.  This  conceptual  averaging  does  not  apply  to  the  noise  present,  so 
that  the  signal-to-noise  ration  (SNR)  is  effectively  reduced.  Also,  the  area 
around  the  peak  is  effectively  flattened  somewhat,  making  the  peak  search  less 
accurate,  and  the  peak-to-background  (or  peak-to-sidelobe)  ratio  is  distorted 
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(these  subjects  are  discussed  in  a subsequent  section).  The  magnitude  of  these 
effects  is  greater,  the  greater  the  patch  size,  because  the  geometric  distortion 
becomes  larger.  Thus,  choosing  a smaller  patch  decreases  the  effects  of  geo- 
metric distortion,  but  the  SNR  is  also  decreased  with  fewer  pixels.  Some 
compromise  is  generally  required,  as  is  discussed  in  a later  section. 

The  effects  of  geometric  distortion  on  binary  edge  correlation  could  be 
drastic  in  certain  cases.  For  example,  a scale  difference  might  prevent  over- 
laying edge  features  on  opposite  sides  of  a patch  at  the  same  time.  Thus,  rather 
than  smearing  the  correlation  function,  as  described  above,  it  could  divide  into 
several  peaks.  This  kind  of  problem  has  not  been  identified  in  typical  patch 
correlation,  but  it  has  been  suspected  of  degrading  the  full  sample-segoent 
correlation  used  in  the  GSFC  LACIE  and  JSC  Processors.  One  solution  to  the 
problem  (at  least  for  coarse  correlation)  might  be  to  resample  the  images  to  a 
coarser  grid  by  use  of  a low-pass  or  median  filter  before  edge  detection.  Then, 
the  geometric  distortions  are  reduced  relative  to  the  pixel  spacing  or,  equiva- 
lently, effective  edge  "thickness . 11 

Other  Techniques  for  Image  Offset  Matching 

Several  other  matching  techniques,  though  not  yet  implemented  in  large- 

scale  registration,  deserve  mention  as  potentially  applicable.  The  Cluster 

13 

Reward  Algorithm  (CRA)  con  dually  analyzes  the  bivariate  histogram  of  the 
two  images  at  each  displacement.  A measure  is  established  characterizing  the 
definition  of  pattern  in  the  histogram,  e.g.,  a measure  of  clustering.  At  the 
offset  denoting  an  image  match  the  histogram  should  show  a relatively  high 
image- to-image  correlation  by  exhibiting  clusters.  The  technique  has  been 
applied  to  several  sample-segnent-size  (about  8x10  km)  scenes  with  notable 
success. 

14  15 

The  point-matching  technique  > , though  designed  primarily  for  target 

arrays  such  as  star  fields,  might  find  application  to  binary  edge  images.  The 
method  minimizes  a geometric  distance  measure  between  points  (say,  edge  pixels 
in  the  two  images)  rather  than  ninimizing  radiometric  or  feature  differences. 

A variation^"*  of  the  method  ascribes  weights  to  the  point-pairs  according  to 
how  well  they  associate  in  the  matching.  This  technique  is  iterative  with  first 


311 


a matching,  then  a comparison  of  the  distance  spanned  by  each  point-pair  to  the 
estimated  common  displacement  for  assigning  a weight,  then  a weighted  match,  etc. 

The  use  of  normalized  cross-correlation  for  minimization  of  um-square- 
differences  or  sum-absolute-differences  described  in  the  previous  section  can 
also  be  viewed  as  an  application  of  maximum- likelihood  classif ication  in  which 
the  measurement  sets  are  distinguished  by  translational  offset  (analogous  to 
pixel  number  in  spectral  classification),  the  channels  of  information  are  the 
pixels  in  the  search  overlay  area  (analogous  to  the  bands  in  spectral  classifi- 
cation), and  the  classes  are  Match  and  Non-match  (analogous  to  classes,  e.g., 
crop  species,  in  spectral  classification).  In  the  spatial  case,  however,  it  is 
known  a priori  that  only  one  measurement  set  should  be  classified  as  a Match  (if 
the  match  scene  is  unique)  corresponding  to  the  single  correct  translational  off- 
set. Analogous  to  spectral  classif icatic  a Bayes  technique  has  been  applied"^ 
to  spatial  matching.  The  probability  of  misacquisition  (match  lock-on  to  the 
wrong  point),  expressed  as  the  Bayes  risk  is  minimized  by  maximizing  the  a 
posteriori  probability  of  a correct  match  (i.e.,  the  probability  that  there  is 
a match  at  an  offset,  given  the  particular  pixel  values  in  the  overlay  region 
for  that  offset).  The  a posteriori  probability  is  estimated  in  principle  by 
least  squares  by  assuming  it  is  a linear  function  of  the  pixel  values.  In  fact, 
that  probability  should  exceed  1/2  only  at  the  match  offset  which  provides  a 
direct  means  for  identifying  a probable  misacquisition  (a  posteriori  probability 
never  exceeds  1/2).  The  method  is  conveniently  implemented  by  Fourier  trans- 
formation techniques.  The  a posteriori  probability,  though  assumed  linear  in 
the  pixel  values  above,  can  be  expressed  as  a linear  combination  of  any  functions 
of  the  measurements,  as  deemed  appropriate  to  the  application.  The  case  of  a 
second-order  relation  has  been  investigated^,  and  trials  on  synthesized  data 
indicate  improvement  over  the  maximum  likelihood  alternative  offered  by  cross- 
correlation. 

The  methods  described  in  this  section  should  be  considered  as  new  candidates 
for  interimage  matching.  They  must  be  integrated  with  the  various  feature  selec- 
tion methods  (e.g.,  the  Cluster  Reward  Algorithm  makes  no  sense  with  binary  edge 
images,  while  the  point  pattern  matching  technique  is  especially  suited  to  such 
images) . The  methods  should  be  tried  on  a representative  set  of  sensor  data  and 
evaluated  for  applicability  to  different  sensor  types,  scene  types,  season, 
sensor-to-sensor  differences,  etc. 


Offset  Determination 


The  cross-correlation  techniques  for  image  matching  presumes  that  the  posi- 
tion of  the  maximum  ot  minimum  cf  the  correlations  or  difference  functic..  charac- 
terizes the  translational  offset  between  the  two  images , The  true  offset  might 
be  in  between  pixel  centers  so  that  the  correlation  peak  lies  between  correlation 
samples.  To  achieve  subpixel  accuracy  in  a given  patch,  some  form  of  interpola- 
tion is  needed.  Several  alternatives  have  been  developed,  as  we  discuss  in 
this  section.  These  techniques  lend  themselves  to  estimating  the  accuracy  of 
peak  location  and  to  evaluating  certain  measures  for  establishing  pass/fail 
status,  and  ve  address  this  subject  also. 

As  an  alternative  to  peak  inte  eolation  for  subpixel  accuracy,  a number  of 
patches  can  be  defintd,  the  peak  can  be  determined  to  the  nearest  sample,  and 
the  subsequent  mapping  function  fit  to  the  numerous  peak  offsets  can  he  relied 
upon  to  yield  subpixel  accuracy.  This  approach  is  predicated  on  the  assumption 
that  a random  position  error  is  introduced  by  choosing  a sample  position  rather 
than  interpolating.  This  method  was  used  in  matching  images  produced  by  the 

GSFC  LACIE  Processor  for  the  purpose  of  evaluating  the  performance  cf  that 
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processor'"’*  . Secondary  peaks  were  also  identified  and  compared  t^  the  primary 
peak.  A measure  of  decline  away  from  the  peak  wr.s  established  in  terms  of 
averages  of  correlation  samples  in  concentric  rings  extending  out  from  the  peak. 
If  the  peak  was  not  strong  enough  relative  to  the  secondaries  or  the  decline  was 
too  shallow,  that  zone  was  rejected  in  the  mapping  function  fit. 

A straightforward  means  of  interpolating  for  the  peak  consists  of  fitting 
a surface  function  to  the  cross-correlation  samples  in  the  vicinity  of  the  neak 

and  evaluating  the  peak  location  analytically.  The  MDP  and  JSC  Registration 
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Processor  * use  a bivariate  polynomial  (i.e.,  containing  terms  x y , MN  ^ poly- 
nomial order).  The  MDP  uses  a fourth-order  polynomial  on  a 5x5  neighborhood 
around  the  peak  and  also  evaluates  the  curvature  at  the  peak  as  a measure  of 
the  breadth  of  the  correlation  peak.  The  smaller  the  curvature  is,  the  larger 
is  the  uncertainty  in  locating  the  peak.  The  MDP  uses  the  minimum  curvature 

on  the  surface  and  the  height  of  the  peak  as  rejection  criteria. 
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The  JSC  Registration  Processor  allows  any  order  polynomial  up  to  and  in- 
cluding fourth  order,  but  the  latter  has  been  used  mainly,  with  the  lower  orders 
18 

being  studied  for  applicability*  The  fit  neighborhood  size  can  also  be 
18 

varied  , tut  a 5x5  has  been  used  in  production.  The  peak  is  located  by  the 
use  of  the  MDP  algorithm,  and  the  curvature  matrix  is  used,  in  lieu  of  the 
curvature  itself,  in  a variational  approach  to  express  the  peak  uncertainty 
covariance  in  terms  of  the  covariance  of  uncertainty  in  the  polynomial  fit  co- 
eri'icients.  Since  the  bivariate  polynomial  is  fit  by  least  squares,  the  coeffi- 
cient uncertainty  covariance  can  be  estimated  from  the  fit  residuals.  Often, 
relatively  few  points  are  fit,  compared  to  the  number  of  coefficients  solved 
for  (25  points  for  a 5x5  neighborhood,  as  compared  to  15  coefficients  for  a 
fourth-order  polynomial) , and  little  confidence  can  be  placed  in  the  uncertainty 
estimate.  To  circumvent  this  problem,  the  user  may  supply  an  a priori  fit  vari- 
ance of  the  fit  uncertainty  rather  than  determining  it  from  the  residuals.  The 
a priori  variance  can  be  established  by  tests  on  representative  data,  whereby 

the  a priori  variance  can  be  adjusted  to  make  the  estimated  peak  uncertainty 

18 

agree  with  the  observed  peak  displacement  errors.  Preliminary  tests  estab- 
lished a value  for  early  production  in  the  JSC  Registration  Processor.  A peak- 
to-hackground  ratio  is  also  established  by  subtracting  from  the  correlation  peak 
value  the  mean  of  samples  away  from  the  peak  and  then  dividing  by  the  standard 
deviation  of  those  samples.  The  subtraction  was  included  to  compensate  for  the 
fact  that  the  edge  image  means  are  not  subtracted  out  in  binary  edge  correlation. 
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Rather  than  establishing  the  orvler  of  the  bivariate  polynomial  a priori* 
successive  orders  could  be  tried  and  the  RMS  residuals  compared*  When  that 
error  talLs  significantly  and  thou  starts  tapering  off.  whatever  order  has 
been  used  at  that  point  is  adopted  as  the  fit.  As  an  attempt  to  sidestep  the 
issue  that  a good  model  of  the  cross-correlat ion  is  not  really  at  hand*  this 
approach  follows  the  rationale  that  a good  representation  lies  somewhere  be- 
tween a simple  model  and  a fit*  with  no  remaining  error*  to  every  point*  as  a 
sufficiently  high-order  polynomial  would  do.  Choosing  an  intermediate  order, 
as  outlined,  attempts  to  balance  a lack  of  understanding  of  the  general  form 
of  the  cross-correlation  function  with  the  knowledge  that  errors  do  exist  in 
the  data  which  makes  forcing  a perfect  lit  unwarranted.  This  problem  of  model 
uncertainties  is  encountered  again  in  the  section  dealing  with  the  mapping 
function. 

Functions  other  than  a bivariate  polynomial  can  be  fit  to  the  cross- 

correlation  samples.  A bivariate  gaussiau  function  is  an  obvious  choice;  how- 

Id 

ever,  its  use  has  not  come  to  our  attention.  One  registration  application 
chose  an  elliptical  cone.  The  orientation  of  the  cone  was  also  a solution 
variable.  Although  surface  fitting  has  been  the  commonest  method  of  peak 
interpolation,  it  is  bv  no  means  universally  accepted.  A principal  criticism 
with  that  method  involves  the  sensitivity  of  the  inters. imple  peak  locution  to 
the  particular  form  of  the  fitting  function. 

As  an  alternative  to  surface  fitting,  the  peak  can  be  assumed  to  lie  at 

the  centroid  ot  the  correlation  neighborhood ' . That  is,  the  peak  location 

is  computed  as  the  weighted  sum  of  neighboring  sample  locations,  with  the 

correlation  vr  Ivies  serving  as  weights.  Analogous  to  the  peak  uncertainty  or 

surface  curvature  meat  toned  earlier*  a corresponding  measure  of  the  breadth 

:i 

ot  the  peak  can  be  computed  as  the  moment  of  gyration  or  simply  as  the 
second  moment  of  the  correlat ion  distribution  (just  as  the  centroid  is  the 
iirst  moment).  Unfortunately  * little  more  can  be  said  about  this  method  at 
this  time.  It  would  be  interesting  to  compare  the  centroid  and  surface  tit 
methods  tor  a representative  set  of  correlation  sample  arrays. 


Another  method  of  peak  location  takes  advantage  of  cross-correlation  by 
Fourier  techniques.  The  offset  in  the  spatial  domain  corresponds  to  a non- 
vanishing phase  in  the  frequency  domain.  In  fact,  if  the  cross-correlation 
function  were  symmetric  about  its  peak,  the  phase  function  would  directly 

specify  the  offset  (since  phase  introduced  by  non-symmetry  would  vanish). 
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One  approach""  transforms  the  phase  portion  of  the  correlation  transform  back 
to  the  spatial  domain  wherein  the  peak  is  located.  The  spatial  result  was 
noted  to  resemble  closely  a delta  function  so  that  subpixel  peak  location 
seems  viable.  The  peak  location  was  facilitated  by  using  the  inverse  transform 
operation  directly  to  compute  a finer  grid  of  spatial  samples  around  the  indi- 
cated peak  than  would  normally  be  obtained  from  Fast  Fourier  Transform  (FFT) 
algorithms.  If  indeed  the  transformed  phase  function  is  consistently  nearly 
a translated  delta  function,  then  in  the  frequency  domain  the  phase  should  be 
proportional  to  the  spatial  displacement.  Thus,  the  phase  vs  frequency  points 
can  be  fit  by  a straight  line  forced  to  pass  chrough  the  origin,  and  the  slope 

gives  the  translational  displacement.  However,  somehow  the  possibility  of  non- 

18 

symmetry  may  need  to  be  accounted  for.  Preliminary  results  have  shown  that 
binary  edge  correlations,  for  example,  do  exhibit  nonsyrametry . 

This  section  closes  by  returning  to  the  issue  of  estimating  peak  location 
uncertainty  or  sharpness.  The  schemes  described  above  can  be  categorized 
basically  into  curvature  at  peak,  second  moment  of  correlation  samples  around 
peak,  and  rate  of  decline  away  from  peak.  Any  of  these  sharpness  measures  can 
be  used  to  compare  with  a rejection  threshold  or  to  construct  a weight  for  use 
in  the  mapping  function  fit.  In  the  latter  case  the  weight  would  be  lower,  the 
broader  the  peak  lobe  is.  The  weight  is  given  directly  by  a peak  uncertainty 
estimate  (as  the  inverse  of  the  uncertainty  covariance).  As  mentioned  earlier, 
a fixed  a priori  surface  fit  variance  should  probably  always  be  used  to  estimate 
the  peak  uncertainty  when  fitting  bivariate  polynomials  so  that  effectively  its 
_ variance  is  directly  related  to  the  curvature.  The  sharpness  measures  can 
also  be  computed  for  the  autocorrelation  function  to  give  an  idea  of  the  intrin- 
sic clarity  of  the  image.  This  application  has  been  implemented  as  well  in  the 
JSC  Registration  Processor. 
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Residual  Mapping  Model 


If  the  approach  of  the  previous  sections  has  been  adopted,  viz*  local 
translational  mismatches  are  determined  at  an  array  of  control  points,  some 
means  is  needed  to  distribute  the  corrections  for  those  mismatches  over  the 
regions  in  between  the  control  points*  Toward  that  end,  a geometric  transformation 
function  is  to  be  lormulated  in  terms  of  the  measured  displacements . The  nature 
of  that  function  depends  upon  one's  confidence  in  the  measured  mismatches  versus 
one's  understanding  of  the  geometrical  or  physical  processes  causing  the  mismatch. 
If  the  control  point  translations  are  expected  to  contain  errors,  and  the  nature 
of  the  geometric  distortions  is  well  understood,  then  some  sort  of  error  mini- 
mization or  maximum  likelihood  estimation  technique  is  utilized.  On  the  other 
hand,  if  the  data  are  highly  trusted  and  the  model  is  unknown*  some  form  of 
"rubber  sheeting"  technique  is  employed  (analogous  to  curve-smoothing  in  one 
dimension).  These  altemat ives  are  addressed  below.  The  case  that  the  model 
is  understood  is  discussed  first,  with  a breakdown  into  a geometry-based  model 
(e.g.,  platform  attitude  error,  trajectory  error,  etc.)  and  a sensor-based 
model  (e.g.,  scan  irregularities,  band-to-band  offsets,  etc.).  Then,  the  rubber 
sheet  approach  is  considered.  If  uncertainty  is  associated  with  both  the  measure- 
ments and  the  model  the  attack  is  not  so  clear.  This  situation  is  considered 
briefly  along  with  the  situation  that  some  measure  of  confidence  in  the  model 
is  available  and  the  control  point  data  are  being  used  to  improve  it.  It  is 
well  established  that  cross-correlat ion  will  occasional l v result  in  an  erroneous 
translational  offset,  and  if  such  an  error  goes  undetected  it  can  ruin  the  mapping 
fit.  The  section  ends  with  a description  of  several  methods  for  identifying 
and  handling  such  outliers. 

Geometric  errors  are  generally  modeled  as  time  varying  satellite  attitude 

3 

and  altitude  errors.  The  MDP  assumes  tor  MSS  processing  that  the  Land sat  yaw, 
pitch,  and  roll  can  be  modeled  as  third-order  functions  of  time  over  the  dimen- 
sions of  a double  frame  (about  340  km  of  downrange)  . Similarly,  the  altitude 
variations  are  modeled  as  linear  in  time.  The  resulting  14  coefficients  are 
solved  for  by  weighted  least  squares  utilizing  both  control  point  offsets  and 
the  less-precise  attitude/altitude  data  available  from  Umdsat 's  attitude 
measurement  system  (AMS)  and  ground  tracking.  The  weights  are  set  up  a priori 
based  on  past  experience  in  control  point  location  accuracies  and  in  AMS  and 
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ground  tracking  accuracies  Hence,  the  control  point  weights  are  considerably 
larger  than  _ne  others  so  that  if  many  control  point  offsets  are  utilized  the 
solution  is  essentially  based  on  them.  However,  if  few  or  none  are  available 
the  AMS  and  ground  tracking  data  do  contribute  appropriately  to  the  solution. 

To  handle  the  fact  that  the  AMS  data  are  poor  for  estimating  the  constant  por- 
tion of  the  model  (biases),  a scheme  is  implemented  to  allow  devoting  the  con- 
trol point  data  to  estimating  the  attitude  biases,  while  the  other  measurements 
are  utilized  for  rates  and  higher-order  coefficients.  Nominally,  this  scheme 
is  employed  only  if  a very  few  control  points  are  available.  Also,  the  attitude 
biases  from  a good  solution  (one  with  control  points)  are  carried  over  to  the 
next  frame  i ‘ that  frame  has  insufficient  control  points  (nominally,  less  than 
two).  A weight  associated  with  that  carry-over  is  propagated  in  a manner  that 
makes  it  decay  with  time,  in  order  to  model  the  growth  in  uncertainty  of  the 
biases  as  the  satellite  moves  further  away  from  the  estimation  point.  This 
whole  approach  is  predicated  on  the  measurement  errors  being  normally-distributed, 
an  assumption  which  breaks  down  if  one  or  several  of  the  control  point  offsets 
are  erroneous.  To  overcome  that  problem,  the  MDP  has  been  tested  with  the 

threshold  number  of  control  points  for  triggering  the  bias  estimation  scheme 

23 

raised  to  15  from  the  nominal  value  of  unity.  Hopefully,  such  a large  number 
of  control  points  will  contain  enough  good  offsets  to  overwhelm  any  erroneous 
ones.  Another  approach  to  eliminating  the  outliers  is  discussed  later. 

24 

A TRW  study  has  adopted  the  same  model  as  the  MDP  except  for  assuming  a 
constant  altitude  deviation.  The  coefficients  were  evaluated  by  Kalman  filter- 
ing. ERIM's  geometric  correction  process  also  models  the  geometric  errors  as 
yaw,  pitch,  and  roll,  with  pitch  and  roll  assumed  linear  and  yaw  assumed  con- 
stant over  the  area  of  interest. ^ 

The  GSFC  LACIE  processor  models  the  geometric  error  (after  the  more-compli- 
cated a priori  transformation)  as  pure  translation  ever  the  dimensions  of  its 

5 9 

8 x 10-km  sample  segments.  Performance  evaluation  * of  that  system  indicated 
thac,  although  specifications  were  met,  there  was  a residual  error  that  appeared 
to  be  affine.  Thus,  the  JSC  Registration  Processor  has  adopted  an  affine  model. 

A weighted  least  squares  solution  is  made  in  which  the  weights  are  the  reciprocals 
of  the  peak  uncertainty  standard  deviations  estimated  from  the  correlation  surface 
fit.  At  user  option,  default  weights  can  be  substituted  if  the  correlation 
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surface  fit  fails  in  its  estimation  process,  or  weights  can  be  eliminated  alto- 

26 

gether.  A preliminary  evaluation  of  the  JSC  Processor  has  indicated  that  an 
affine  model  is  adequate;  that  is,  observed  residual  distortion  does  not  show 
any  systematic  effect  associated  with  an  incomplete  geometrical  description. 

The  success  of  the  affine  model  lies  in  the  fact  that  the  JSC  Registration 
Processor  is  only  removii  g residual  distortion  left  by  the  MDP.  The  a priori 
geometric  correction  has  taken  care  of  map  projections,  sensor  geometry,  and 
sensor  line  effects  as  characterized  by  the  MDP  data  (a  priori  modeling  con- 
stants and  attitude/altituue  solution). 

Sensor  effects  can  also  be  modeled  and  solved  for  by  use  of  the  acquired 
scenery.  Alternatively,  they  can  be  assumed  static,  determined  from  a priori 
data,  such  as  laboratory  or  flight  tests,  and  then  used  in  the  a priori  geometric 
correction.  Landsat  MSS  effects  include  scan  nonuniformity,  band-to-banu  offset, 
"staircasiug"  caused  by  simultaneity  of  six  scan  lines,  and  line-by-lin^  offsets 
due  to  sampling  delays  and  changes  in  scan  speed.  The  MDP,  GSFC  LACIE  Processor, 
and  JSC  Registration  Processor  all  assume  a static  model  for  those  effects.  All 
effects  are  assumed  constant,  except  for  the  scan  speed  and  scan  nonuniformity. 

The  latter  is  modeled  as  a third-order  polynomial  in  position  with  the  line  (i.e., 
sample  number).  The  coefficients  were  determined  prior  to  implementation  in  the 
registration  systems.  The  scan  speed  is  assumed  to  have  a fixed  relation  to  the 
number  of  samples  actually  obtained  in  a scan  line  (line  length  majority) . Al- 
though this  model  seems  fairly  good  in  normal  circumstances,  it  breaks  down  for 
Landsat  3 when  the  MSS  sample  initiation  fails  (the  "late  line  start")  because 
the  correct  line  length  majority  is  not  available.  A model  has  been  installed 
in  the  GSFC  processing  line  to  estimate  the  line  length  majority  from  the  number 
of  samples  in  the  partial  line.  The  resulting  line  length  majority  is  used  by 
both  the  MDP  and  the  JSC  Registration  Processor.  An  inaccurate  line  length 
majority  is  manifested  as  a line  jitter  over  portions  of  the  image,  and  ir.Jeed 
a jitter  is  sometimes  apparent  as  irregular  field  boundaries  in  some  Landsat  3 
agricultural  scenes  (especially  at  lower  lattitudes  where  field  boundaries  tend 
to  be  parallel  to  lines  and  columns  of  pixels).  An  error  of  one  in  the  line 
length  majority  will  result  in  a misregistra tion  of  up  to  one  pixel  or  about  58  m 
in  MSS  imagery.  The  possibility  of  variations  in  scan  nonuniformity  can  also  not 
be  ruled  out  as  the  cause.  These  anomalies  merit  further  investigation.  Tech- 
niques for  iine-to-line  registration  to  straighten  field  boundaries  should  be 
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considered,  if  for  no  other  purpose  than  clarifying  operational  scan 
characteristics . 

The  sensor  geometrical  model  for  the  Laudsat  RBV  is  considerably  simplified 
by  the  presence  of  reseau  marks  on  the  face  of  the  Vidicon  tube.  Also,  the 
satellite  attitude  model  is  simplified  by  the  fact  that  a whole  frame  is 
gathered  at  one  instance,  hence,  for  one  value  of  roll,  pitch,  and  yaw. 

The  rubber  sheet  approach  to  geometrical  modeling  assumes  the  form  of  the 
model  is  poorly  understood.  Whatever  is  the  correct  model,  it  should  be  possi- 
ble to  express  it  as  a bivariate  polynomial  (e.g.,  assume  a Taylor  series). 

Thus,  a common  rubber  sheet  technique  fits  a polynomial  to  the  array  of  control 

point  offsets.  The  JSC  Registration  Processor  and  the  GSFC  Digital  Image  Recti- 
27 

fication  System  can  utilize  polynomials,  the  former  to  fourth  order  and  the 
latter  to  second  order.  The  principal  concern  is  generally  what  order  to  use, 
although  omission  of  certain  terms  may  also  be  considered  (such  as  sample- 
dependent  terms  if  distortions  seem  to  be  from  line  to  line).  A sufficiently 
high  order  will  fit  all  control  points  with  dubious  resuits  in  between.  If  the 
points  are  known  rigorously  to  contain  no  error,  thou  fitting  all  the  points  is 
reasonable,  and  the  problem  becomes  one  of  selecting  an  interpolating  function 
with  suitable  behavior  between  the  points.  General  , the  control  points  are 
assumed  to  have  errors  so  that  fitting  them  rigorously  at  the  risk  of  inter- 
point error  is  not  particularly  suitable.  A compromise  is  often  achieved  by 
trying  a progression  of  successively  higher-order  polynomials  and  tracking  the 
decrease  of  the  error,  expressed  as  the  RMS  of  fit  residuals.  Assuming  the 
idea  that  lower  order  is  better  for  inter-point  behavior,  the  fit  is  chosen  for 
which  the  error  has  dropped  substantially  from  lowest  order  but  for  which  little 
error  reduction  is  apparent  at  higher  orders. 

Another  rubber  sheet  approach  effectively  spatial-fillers  the  "sampled" 
offsets  at  the  control  points,  thereby  distributing  the  offsets  over  areas 
between  the  control  points.  This  approach  parallels  the  reconstruction  of  a 
two-dimensional  analog  signal  from  its  samples  by  cubic  or  sine  convolution. 

The  filter  might  be  derived  from  maximum  likelihood  considerations  such  as  a 
Kalman  filter.  This  approach  might  be  reduced  to  any  desirable  scale  by  reducing 
the  size  of  control  points  while  increasing  their  density  so  that  a fairly 
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high-frequency  matching  process  could  be  designed.  When  sensor  resolution  be- 
comes good  enough,  atmospheric  turbulence  will  be  discernible  as  high-frequency 
distortion  for  which  such  a high-frequency  geometry-matching  filter  would  be 
appropriate . 

Sometimes,  the  model  may  be  partially  known  before  control  point  informa- 
tion is  acquired;  that  is,  a priori  values  for  the  model  parameters  are  available 
with  an  associated  covariance  characterizing  the  level  of  confidence.  Then,  the 
control  point  offsets  provide  additional  information  which  can  be  used  to  improve 
the  estimates  of  the  model  parameter.  A Bayes  approach  is  utilized.  Simply 
stated,  a least  squares  solution  is  performed  on  the  control  point  offsets,  and 
a weighted  average  of  the  results  with  the  a priori  estimate  is  computed.  The 
weights  are  the  inverses  of  the  respective  covariances  normalized  by  matrix  pre- 
multiplication by  the  inverse  of  the  sum  of  the  covariance  inverses.  This 
approach  has  been  implemented  in  the  JSC  Registration  Processor  to  account  for 
the  fact  that  it  follows  the  MDP.  Since  the  MDP  has  already  geometrically 
corrected  the  data,  the  a priori  values  for  the  residual  mapping  function  are 
zero.  The  covariance  of  the  MDP's  attitude/altitude  solution  is  provided,  and, 
after  transformation  to  the  covariance  of  a local  (8 x 10-km  sample  segment) 
affine  geometrical  model,  it  serves  as  the  a priori  covariance.  The  JSC  Proc- 
essor performs  its  own  least  squares  solution  and  utilizes  its  and  the  a priori 
covariances  to  average  its  solution  with  zero  (the  MDP's  value).  The  appropri- 
ate expressions  are  summarized  in  Figure  2.  Effectively,  the  result  down-weights 
the  JSC  Processor's  solution  according  to  the  size  of  the  MDP  covariance,  with 
greater  attenuation  the  smaller  the  MDP  covariance.  It  must  be  borne  in  mind 
that  all  this  theory  is  predicated  on  the  MDP's  and  JSC  Processor's  error  sources 
being  normally-distributed.  A crude  compensation  (shrinkage)  is  provided,  as 
shown  in  Figure  2,  in  case  they  are  not  normally-distributed. 

Unfoi innately , control  point  correlations  tend  to  either  work  reasonably 

well,  or  they  are  very  bad.  Thus,  unless  false  fix  detection  is  very  good, 

erroneous  control  point  offsets  will  be  interspersed  among  the  good  ones.  One 

straightforward  approach  to  eliminating  the  outliers  simply  comp,  res  the  residuals 

after  the  least  squares  fit  to  a preset  threshold,  or  a threshold  scaled  by  the 

estimated  covariance.  Thio  technique  was  used  in  the  GSFC  LACIE  Processor  eval- 
5 9 

uation  ? . Control  points  with  residuals  greater  thin  three  standard  deviations 
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were  discarded,  and  the  least  squares  solution  was  repeated.  The  new  residuals 
were  again  tested,  and  the  procedure  was  repeated  until  no  more  failures  were 
noted . 

Another  approach  performs  a least  squares  solution  with  one  control  point 
omitted.  Similarly,  another  solution  is  made  with  the  first  control  point  re- 
turned but  a second  omitted,  and  the  process  is  repeated  to  yield  as  many  solu- 
tions as  there  are  control  points.  The  post-solution  residual  for  each  omitted 
control  point  may  then  be  examined  for  rejection,  or  a weighted  combination  of 
all  the  solutions  may  be  made,  with  the  weights  related  to  the  post-solution 
residuals. 

28 

Finally,  a robust  estimation  technique  can  be  utilized  in  which  the  con- 
trol point  error  is  assumed  to  come,  not  from  a normal  distribution,  but  from  a 
distribution  with  long  tails  which  characterize  the  possibility  of  "outliers . 11 
Just  as  least  squares  is  a maximum  likelihood  estimator  for  a normal  distribu- 
tion, maximum  likelihood  estimators  can  be  formed  for  other  longer-tailed 

28 

distributions.  A number  of  such  solution  techniques  exist.  They  down-weight 
measurements  with  large  errors,  while  sacrificing  a small  amount  of  efficiency 
(i.e.,  not  being  quite  as  good  as  least  squares)  when  the  measurement  errors 
really  are  normally-distributed.  To  our  knowledge,  none  of  these  techniques 
have  been  explored  for  image  matching. 

Sizing  and  Placement  of  Control  Points 

The  method  of  inter-image  comparisons  reviewed  here  involve  the  distributing 
of  a number  of  patches  within  each  image  (the  reference  image  and  the  registrant 
image).  The  etches  are  chosen  small  enough  that  the  inter-image  shifts  within 
them  raiv  be  considered  to  be  purely  translational;  that  is,  scale,  skew,  and 
other  interinage  distortions  have  negligible  effect  when  compared  to  the  trans- 
lation, viewed  on  the  scale  of  the  patch.  Translation  we  will  regard  as  zeroth 
order,  amounting  to  a constant  bias  in  the  functions  that  relate  coordinate 
values  in  one  image  to  coordinate  values  in  the  other.  Similarly,  scale,  rota- 
tion, and  skew  are  first  order  distortions,  and  keystoning,  etc.,  are  higher 
order.  In  the  zeroth  order,  coordinates  in  the  reference  image  and  in  the 
registrant  image  are  related 
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(xi  "yi)  = bi  » 


while  to  first  order  they  are  related 

(Xi-y^  = +b±  . 

So,  it  is  seen  that  the  above  description  of  the  order  corresponds  to  the  order 
of  the  polynomial  in  the  equations  relating  the  coordinates.  The  essence  of 
registration  is  to  specify  the  mapping  between  the  reference  and  registrant 
images,  which  is  done  in  either  "rubber-sheeting”  form  or  by  modeling.  The 
latter  uses  rigid  descriptions  of  the  sensor  geometry  to  permit  an  economy  in 
describing  the  interimage  coordinate  relationship.  Sc,  rather  than  describing 
the  coordinate  relationship  in  the  form  above,  coefficients  are  often  drawn 
that  relate  the  coordinates  through  platform  ephemerides  and  known  sensor 
geometries.  This  section  interrelates  with  the  previous  one  via  economic  and 
accuracy  considerations;  an  optimum  mapping  method  will  require  the  fewest  con- 
trol patches  to  establish  the  desired  degree  of  accuracy,  since  there  is  a high 
cost  per  correlation  patch. 

Number,  location,  and  size  of  the  patches  used  for  control  points  is  a 
very  important  consideration  in  the  design  of  a registration  system,  from  both 
economic  and  accuracy  standpoints.  A large  part  of  the  registration  computation 
load  is  proportional  to  the  number  of  the  patches  and  to  the  second  power  of  the 
patch  dimension,  so  it  behooves  one  to  minimize  the  number  and  individual  size 
of  the  patches.  At  the  same  time  the  interaction  of  the  spatial  distribution  of 
the  patches  with  the  remapping  model  will  affect  the  accuracy  of  the  registra- 
tion; so  the  location  of  the  population  of  patches  is  a consideration  to  be  com- 
bined with  their  number.  One  patch  gives  a single  estimation  of  the  translational 
correspondence  between  the  images  in  the  vicinity  of  the  patch.  If  it  be  assumed 
that  errors  are  not  systematic  in  the  estimation  of  that  translational  corre- 
spondence, more  patches  (in  a neighborhood)  are  better  in  that  the  errors  will 
tend  to  cancel.  However,  although  there  is  no  conceptual  difficulty  with  having 
patches  overlap,  there  is  a limit  to  the  number  of  functionally  independent 
; itches  that  can  be  drawn  from  any  image.  That  number  puts  an  upper  limit  to 
the  tendency  for  growth  to  larger  number  of  patches  in  order  to  have  statistical 
cancellation  of  errors. 
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There  is  a tradeoff  in  the  determination  of  the  optimum  size  of  a correla- 
tion patch  that  is  dependent  on  the  accuracy  with  which  the  a priori  corrections 
can  account  for  the  encountered  misregistration.  Consider  first  a purely  trans- 
lational misregistration.  As  the  size  of  the  patch  gets  larger,  there  is  more 
picture  structure  within  it;  although  the  value  of  the  correlation  peak  is  not 
affected,  at  translational  locations  off  the  peak  there  will  be  (generally) 
lower  cross-correlation  values  due  to  the  larger  amount  of  structure  within  the 
window.  The  result  is  an  enhancement  of  the  peak-to-background  ratio  (the  value 
of  the  peak  correlation  divided  by  the  correlation  in  the  general  vicinity), 
enabling  increased  sensitivity  in  detecting  a peak  and  perhaps  increased  accura- 
cy in  determining  the  location  of  the  peak. 

Now,  however,  consider  the  ramifications  of  first-order  departures  from  the 
condition  in  which  there  are  only  translational  offsets  between  the  images  being 
registered  (i.e.,  suppose  there  are  skew  and  scale  differences  as  well  as  trans- 
lation). In  the  position  in  which  the  true  centers  of  the  patches  being  corre- 
lated are  coincident  (that  is,  the  position  one  would  want  to  find  as  a result 
of  the  cross-correlation  process),  picture  structure  towards  the  edges  of  the 
patches  will  be  relatively  displaced  by  scale  and  skew  differences.  In  contrast 
to  the  translation-only  situation,  the  correlation  in  this  case  is  reduced  as 
the  size  of  the  image  is  increased.  But  the  presence  of  effects  other  than 
translational  offsets  does  not  mandate  the  use  of  the  smallest  possible  patch — 
one  pixel! — because  the  correlation  is  at  its  noisiest  there.  For  a binary  ex- 
tracted feature  on  which  correlation  is  being  done,  the  correlation  takes  on 
only  the  values  zero  or  one  for  the  one-pixel  patch,  and  it  would  be  impossible 
to  locate  a peak.  So  one  determines  an  optimum  patch  size  by  considering  a 
reasonable  envelope  for  the  distortions  (beyond  translational)  that  one  expects, 
and  works  out  the  spatial  range  over  which  they  would  cause  significant  displace- 
ments for  the  translationallv-correct  position. 

Where  appropriate  by  necessity  of  increased  registration  accuracy,  a re- 
entrant technique  is  possible.  In  that  technique,  patches  of  the  original 
images  are  extracted  and  run  through  the  correlation  process.  The  resulting 
remapping  for  the  whole  image  is  then  used  to  reextract  the  correlation  the 
correlation  patches,  which  can  now  be  at  least  first-order  corrected  for  the 
modeled  distortions.  Hie  patches  ar*>  extracted  from  tue  input  imagery  by 
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resampling  onto  a grid  derived  from  the  first  registration  process,  and  conse- 
quently larger  patches,  with  potential  for  increased  accuracy,  may  be  drawn. 
The  cost  of  such  a reentrant  technique  is  not  necessarily  to  double  the  compu- 
tation time,  inasmuch  as  a coarser  registration  job  is  enabled  for  the  first 
pass. 


As  mentioned  earlier,  the  strategy  for  location  of  the  correlation  patches 
is  important.  In  the  case  of  the  MDP,  there  is  a scattering  of  patches  amount- 
in'* to  approximately  0.1%  of  the  scanned  area  (say  10  patches  of  32  x 32  pixels 
within  a frame  of  3596x  2983  pixels).  In  order  for  this  small  a correlated 
area  to  control  the  overall  registration  accuracy  to  an  acceptable  level,  the 
patches  must  be  lo*  ated  efficiently  so  as  to  exercise  reasonable  control  over 
the  entire  image.  Further,  the  modeling  of  the  scanner  behavior  betweer  control 
points  becomes  of  paramount  importance.  In  the  other  extreme,  the  JSC  Registra- 
tion Processor  actually  uses  something  over  100%  of  the  area  of  the  registrant 
image,  when  it  is  taken  into  account  that  the  patches  overlap  slightly  (about 
7 pixels/line). 

The  registration  of  two  images  logically  breaks  into  two  philosophically 
different  kinds  of  operations — the  determination  of  the  mapping  of  the  coordi- 
nate grid  of  the  reference  image  into  the  coordinates  of  the  registrant  image 
onto  that  remapped  grid  of  the  reference  image.  The  mapping  process  is  guided 
by  the  selection  of  patches  within  which  interimage  comparisons  give  the  local 
estimate  of  the  mapping  (typically  just  the  translational  characteristics  are 
determined  on  an  area  small  enough  that  translation  is  the  dominant  effect  over 
the  size  of  the  patch).  Since  considerable  computation  effort  goes  into  the 
interimage  comparisons  done  on  the  patches,  and  since  the  accuracy  of  the  over- 
all registration  defends  linearly  on  the  accuracy  with  which  a single  patch  is 
compared  between  images,  and  also  since  the  model,  usually  driven  by  the  trans- 
lational offsets  determined  at  the  patches,  will  be  more  tightly  and  accurately 
determined  with  a "sufficient"  number  and  distribution  or  patches,  it  is  very 
important  that  the  following  qualities  are  achieved  in  the  location  of  the 
control  patches. 

1.  The  comparison  method  allows  an  accuracy  of  interimage  comparison  at  least 
as  good  as  the  registration  accuracy  desired  for  the  whole  process.  Other- 
wise one  must  use  a superfluity  of  control  patches  and  hope  tnat  they 
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contribute  Independent  measurements,  with  error  cancellation,  to  the  re- 
mapping model. 

2.  The  model  being  driven  by  the  control  patches  is  suffici^  . ..y  highly  de- 
tailed to  account  for  the  entire  behavior  of  the  relative  geometry  in 
between  control  points. 

3.  Tha  locations  of  the  control  points  are  chosen  to  interact  sensitively 
with  the  modeling  geometry.  For  example,  if  a sinusoidal  component  to  the 
interimage  geometry  is  hypothesized,  one  would  not  want  control  points  (the 
centers  of  the  patches)  placed  at  uniform  one-period  separations  within  the 
image.  If  they  were,  aliasing  would  have  the  result  of  a sinusoidal  rela- 
tive geometry  look  the  same  as  a translational  offset. 

This  section  discusses  some  aspects  of  location  of  control  points  (taken  as  the 
centers  of  their  control  patches). 

Let  the  registration  of  Image  1 to  Image  2 be  defined  as  the  mapping  of 
the  coordinates  (i,j)  in  Image  1 to  tne  coordinates  (k,1)  in  Image  2 (i.  , we 

will  do  only  the  geometric  portion  of  the  problem). 


i -►  k -* 


j 

IMAGE 

i 

IMAGE 

i 

4- 

2 

Suppose  the  "true  relationship  is  given  by  F..  and  F, 


i = Fi(k,l) 


j = F2(k,i); 


let  them  be  estimated  as  a result  of  the  interimage  correlation  and  modeling  by 


fl  = Fl’ 


f =*  F 
2 2 


Then  the  root-mean-square  registration  error  (RMSE)  is 


RMSE 


-'/ST  i:  t(Fr£i>2  + <v£2>2>dA 

v image 
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where  is  the  integral  over  the  area  of  the  image,  and  various  assumptions 

are  included  regarding  orthogonality  of  the  coordinate  axes,  samene  s of  scale 
on  those  axes,  itc . Further,  suppose  the  mapping  f^  and  f^  to  be  derived  accord- 
ing to  some  sensor/platform  model,  or  ac-  ording  to  other  limitations  on  the  com- 
plexity such  as  a mapping  of  no  higher  order  than  affine,  and  chat  the  mapping 
f^  and  fj  is  determined  by  a finite  number  of  control  pcnts  within  the  images. 

If  the  images  are  not  initially  pathologically  misregistered,  we  cay  reasonably 
express  the  mapping  by  beginning  with  the  simplest  of  mappings, 

f1(k,l)  - k , f2(k,l)  * 1 

and  then  include  the  deviations  g^, 

f^k.l)  - k + gx(k,l),  f2  = 1 + g2(k,l). 

This  slightly  complicates  the  express  on  for  RMSE  but  facilitates  the  analysis 
of  sensitivity  with  respect  to  control  point  location.  Translational  offsets 
are  written 

«2(M)  - b„ 

affine  mappings  have  the  general  form 

g^(k,l)  * uq  + a^k  + a^l 

g9(k,l)  - b + b,k-+  b.l  ; 

2 oxZ 

keystoning  is  modelable  by  the  inclusion  of  a cross  term, 
g^  (k,l)  = aQ  + a^k  + ^l  + a3kl 
g2(k,l)  = bQ  + b^k  + b^l  4-  b^kl  , 

etc . 

We  consider  a control  point  established  between  the  images.  Let  t_(k^l) 
be  the  derived  estimate  of  the  ’true11  cffset  between  the  images,  and  let  E 
be  the  estimated  covariance  of  the  estimate  t. 
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By  a method  unspecified  here  (so  as  co  preserve  generality),  the  set  of  control 
points  {km,  1m,  tm,  Em}  is  then  used  to  generate  the  mapp'.ig  tunctions  and  g^* 
Let  us  make  some  simplifying  assumptions: 

1.  The  method  of  obtaining  g^  and  g^  will  work  with  any  number  of  control  points 
(e.g.,  no  control  points  gives  g^  and  identically  zero,  one  control  point 
allows  a translational  solution,  etc*)* 


2*  The  method  of  obtaining  g^  and  g^  is  tractable  to  linearization. 

3.  A priori  estimates  of  E are  available  (they  might  be  in  the  form 
Eap  - diag(aj,  op  or  - c2I  . 

4*  The  a priori  estimates  of  E are  independent  of  location. 

5*  The  a priori  estimates  of  g^  and  g^  are  zero.  (Otherwise  the  image  could 
be  adjusted  according  to  the  a priori  estimates  so  that  this  would  be  true.) 


We  are  now  in  position  to  find  the  sensitivity  of  the  mapping  functions  and 
to  the  location  of  a single  control  point,  that  sensitivity  being  a function  of 
location  of  control  po  nt  in  the  reference  image  and  of  location  in  the  registrant 
image.  The  sensitivity  can  be  converted  into  an  rms  value  by  integration  over 
the  registrant  image,  as  will  be  seen,  and  thus  an  ideal  location  of  the  first 
control  point  is  specified. 


i k 

Defining  y_  = (^),  x = (^),  we  have  used  the  set  {x_,  t_,  E}  to  produce  the 
(vector)  fu* .Lion  £ such  that 

= &(x)  + k. 

The  fact  that  the  variation  in,  say,  the  first  coordinate  of  v is  given  by 


9g-,  3gi 

6yi  = 5xi  + a^ 


<5x„ 


leads  us  to  the  vector  variation  in 
6^  = J ox  , 

in  which  J ia  the  Jacobian  matrix 
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The  covariance  in  y_  is  calculated  from  1^,  the  covariance  in  x,  as  follows. 

* ^ 6x  (SxT  J_  T . 

T 

Taking  expectation  values,  and  assuming  that  the  expectation  of  5x_  * s as 

estimated  from  the  considerations  of  the  cross-correlation  surface  for  the  point, 

Ey  * E{(<$y)  (6y)T}  « J_  E{(6x)(6x)T}  J T 

£ ■ ] £ J T 

which  will  be  a non-constant  function  of  inasmuch  as  the  partials  forming 
are  not  constant.  The  trace  of  gives,  as  a function  of  v,  the  squared  regis- 
tration uncertainty.  We  can  average  over  the  image  and  take  the  square  root. 

* 

RMSE  = v / — — //  trl  dA 

V area  y 

N image 

Alternatively  the  trace  can  be  takei;  after  integration  (the  operations  communite) 

f T * 

RMSE  - \ / tr  ( . //  Z dA)  . 

area  image  v 

Note  that  the  RMSE  so  calculated  is  a function  of  x,  the  location  of  the  first 
control  point.  If  a priori  values  for  and  t_  (x)  are  used  (the  latter  being 
zero),  we  have  an  a priori  estimate  of  the  sensitivity,  measured  in  terras  of 
coordinates  in  the  image,  as  a function  of  location  of  the  first  control  point. 
Fixing  the  location  of  the  first  control  point  at  the  location  that  minimizes 
RMSE,  then  an  exactly  similar  procedure  leads  to  the  location  of  the  best  place 
to  position  the  second  control  point.  The  RMSE  should  monotonically  decline  as 
the  number  of  optimally-placed  control  points  increases,  and  the  system  designer 
can  quit  adding  control  points  when  the  anticipated  accuracy  has  gotten  to 
requirement  level. 
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It  is  true  that  the  placement  of  n control  points  by  this  technique  will 
(probably)  not  produce  as  good  accuracy  as  n points  placed  optimally  as  an  en- 
semble. The  algorithm  for  determining  that  optimal  ensemble  position,  however, 
is  a substantially  more  complicated  one.  The  following  relaxation  technique  is 
such  an  algorithm.  The  n points  are  placed  according  to  some  scheme  in  the  image, 
and  RMSE  is  calculated  in  the  general  manner  as  described  above.  The  position 
of  the  first  point  is  permitted  to  vary  about  its  original  location,  and  RMSE  is 
observed;  the  location  is  altered  until  a minimum  of  RMSE  against  first-point- 
location  is  found.  Then,  the  second  is  allowed  to  vary,  and  its  minimum  location 
found.  Similarly  through  the  set  of  n control  points,  and  the  procedure  is 
iterated  for  all  the  control  points  again  until  each  point  is  at  a minimum.  But, 
even  this  relaxation  technique  guarantees  only  a relative  minimum,  for  small  de- 
viations of  control  point  location.  The  sequential  technique  is  likely  to  require 
more  points  to  achieve  a given  level  of  anticipated  accuracy  than  the  minimum 
number  meeting  the  requirements  with  the  relaxation  technique,  but  the  sequential 
technique  is,  as  mentioned  earlier,  more  tractable. 

This  problem,  optimizing  locations  of  control  points,  is  analogous  to  the 
statistical  problem  of  selecting  a set  at  which  to  evaluate  the  associated 

set  , the  combination  to  drive  a regression  between  x and  y.  It  has  proven 
more  practical  to  select  an  oversupply  of  x^fs  and  drop  members  one  at  a time 
according  to  a utility  criterion,  until  the  required  performance  would  fail  if 
any  further  members  were  dropped.  A practical  scheme  for  location  of  control 
points  could  proceed  similarly. 

All  too  often,  a desired  control  point  location,  even  with  the  allowance  of 
small  deviations  around  it,  will  not  contain  picture  structure  to  permit  suffi- 
ciently accurate  cross-correlation.  The  strategy  for  control  point  location 
should  be  robust  against  failure  to  find  proper  structure  at  a subset  of  the 
ideal  control  point  locations.  An  iterative  scheme  is  envisioned,  in  which  that 
failure  would  send  one  back  to  the  image  to  obtain  another  set  of  control  points. 

These  techniques  seem  clearly  impractical  for  one-shot  application.  The 
amount  of  time  spent  in  the  computations  could  better  have  been  spent  in  getting 
on  with  the  registration  problem  by  casting  an  overkill  of  control  points  into 
the  image,  and  just  proceeding.  The  application  for  such  techniques  is  in  a 
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production  environment*  where  the  fewest  control  points  vith  the  most  advantageous 
effect  is  desired.  Using  the  remapping  model  and  the  a priori  estimates  of  the 
covariance*  a general  optimal  strategy  for  control  point  location  is  drawn.  The 
covariance  estimation  is  done  either  entirely  without  prejudice  (E  « oz I)*  or 
if  a large  number  of  images  are  to  be  registered  against  a single  base  image  (as 
in  the  authors'  case*  multitemporal  agricultural  images  of  certain  ground  areas), 
that  base  image  can  be  investigated  for  the  estimations  of  E. 

To  the  authors*  knowledge,  this  sort  of  optimal  placing  of  control  points 

has  not  been  done.  The  MDP  uses  hand-picked  control  points  with  control  in  any 

given  frame  of  Landsat  data  coming  from  not  only  that  frame  but  from  adjacent 

4 

frames  as  well.  In  the  LACIE  Processor  , there  was  essentially  only  a single 

point,  the  entire  image;  translational  registration  alone  was  done,  with  nearest- 

neighbor  resampling  following  translational  correlation  done  on  whole-segment 

19 

basis.  An  experiment  associated  with  the  LACIE  Processor  utilized  five  control 

points  placed  at  the  corners  and  center  of  the  image.  In  the  DAM  Package^,  manual 

control  points  are  selected  vith  admonishments  to  spread  them  out  well  in  the  image 

6 7 

being  registered,  the  JSC  Registration  Processor  * , the  control  points  are 

placed  on  a uniform  grid,  the  patch  size  and  spacing  relating  so  as  to  cause 

31 

overlap.  In  the  ’'automatic”  registration  system  for  the  LACIE  ground  truth 
segments,  control  points  are  initially  placed  on  a uniform  grid,  with  small 
deviations  allowed  in  order  to  find  a suitable  correlation  peak,  in  all  the 
processors  with  which  the  authors  are  familiar,  it  has  been  the  practice  to 
follow  one's  instincts  rather  than  to  code  in  a sophisticated  patch  location 
algorithm.  The  success  of  those  processors  indicates  the  eff*  ~ of  the  less- 
elaborate  methods,  but  it  remains  possible  to  make  algorithmic  . iprovements  to 
permit  sufficient  accuracy  with  minimum  computation  load. 


Non-Control  Point  Methods 


The  previous  sections  dealt  with  the  step-wise  manner  of  first  matching 
images  within  local  patches  or  control  points  and  then  fitting  the  full  mapping 
function  to  the  resultant  array  of  point-shifts.  Although  the  complexity  of 
straightforward  multidimensional  correlation  (say,  in  translation,  rotation, 
scale  change,  etc.)  gent'.rally  makes  it  prohibitive,  a fortuitous  property  of 
affine  distortions  ujider  Fourier  transformation  has  given  rise  to  such  a method 
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which  may  show  promise.  It  is  shown  that  even  with  affine  distortions  (i.e., 
rotation,  scale  change,  and  skew  or  shear  distortion,  in  addition  to  pure  trans- 
lation) the  translation  maps  into  a phase  factor  in  the  frequency  domain,  and 
the  modulus  of  the  transform  function  exhibits  a similar,  affine  distortion. 

This  fact,  coupled  with  the  fact  that  typical  agricultural  scenery  shows  con- 
siderable spatial  structure,  facilitates  the  use  of  Fourier  transforms  tor  match- 
ing in  an  easier  way  than  with  the  images  themselves.  The  structure  of  agricul- 
tural scenes  generally  casts  the  major  portion  of  the  spectral  energy  (i.e., 
transform  modulus)  along  two  n early-perpendicular  axes,  corresponding  to  the 
presence  of  rectangular  field  and  road  structure.  In  that  case  the  axes  of  the 
two  transformed  images  can  be  sought  out  by  searching  for  lines  of  maxima,  and 
the  matching  need  only  occur  over  the  axes,  rather  than  over  the  whole  domain. 

The  rotation  and  skew  are  determined  by  rotating  corresponding  axes  into  coin- 
cidence, and  scale  changes  are  determined  by  matching  energy  distributions  along 
the  axes.  Once  the  linear  portion  of  the  affine  transformation  has  been  deter- 
mined (wholly  from  the  modulus),  the  translation  is  determined  from  the  phase. 
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The  method  was  used  successfully  to  determine  rotation  and  skew  distor- 
tion in  airborne  scanner  data.  It  is  not  certain  that  modulus-matching  along 
the  axes  for  scale  change  determination  is  sensitive  enough  to  give  a good  scale 
solution  because  the  modulus  probably  changes  far  more  slowly  along  an  axis  than 
traverse  to  it.  This  question  should  be  addressed  and  the  method  tried  on  other 
data  types  and  scene  types  before  furthi * conclusions  are  drawn.  At  present, 
the  method  does  seem  applicable  to  agricultural  images  in  which  only  transla- 
tion, rotation,  and  skew  are  present. 

Summary  and  Conclusions 

A number  of  image  correlation,  match  offset  determination,  control  point 
placement,  and  geometrical  modeling  techniques  are  in  use  today,  but  there  is 
still  considerable  ground  to  cover.  There  appears  to  have  been  little  effort 
in  interchanging  methods,  e.g.,  trying  different  offset  determination  techniques 
with  each  matching  technique,  etc.  Perhaps  the  greatest  potential  for  correla- 
tion improvements  lies  in  increased  computational  efficiency  and  speed.  Several 
new  matching  techniques  appear  to  show  promise,  but  they  need  to  be  tested  on  a 
wider  range  of  image  data.  There  is  room  for  improvement  in  the  robustness  of 
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offset  determination  schemes*  The  various  schemes  need  to  be  compared  when  used 
with  representative  data.  Improved  techniques  for  identifying  false  fixes  with- 
out rejecting  good  fixes  are  seriously  needed* 

Methods  of  modeling  sensor  anomalies  such  as  late  line  start  perturbations 
need  further  investigation.  Is  the  current  MSS  scan  nonuniformity  model  adequate, 
or  does  it  change  with  time?  More  attention  to  the  degrading  effects  of  geometric 
distortion  on  cross-correlation  is  needed  by  evaluating  tradeoffs  between  patch 
size  and  iterative  registration.  Control  point  placement  techniques  need  to  be 
compared  in  terms  of  overall  performance;  particularly,  the  adaptive  placement 
scheme  described  earlier  needs  to  be  tested.  Robust  estimation  techniques  snould 
be  investigated  for  their  applicability  to  registration. 
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TEMPLATE  MATCHING: 


l (REFERENCE  PIXELS)  X (SEARCH  PIXELS) 

WINDOW 

l (SEARCH  P 1 XELS) 2 

W 1 NDOW 


- FOR  EDGE  IMAGES: 

NO.  OF  COINCIDENCES 
NO.  OF  SEARCH  EDGES 


P (SEARCH  PIXEL=EDGEj REF.  P I XEL=EDGE) 


"CLASSICAL"  CORRELATION: 


I (REFERENCE  PIXELS)  X (SEARCH  PIXELS) 

WINDOW 

Z (REFERENCE  PIXELS)2  X l (SEARCH  PIXELS)2  Jl 

WINDOW  WfNDOW 


- FOR  EDGE  IMAGES: 

NO.  OF  COINCIDENCES 

V (NO . CF  REF.  EDGES  /nO . SEARCH  EDGES 


= / PC SEARCH=EDGE ( REF=EDGE ) P( REF^EDGE | SEARCH- L OGE ) 


figure  A.  Normalization  Options  For 

Registration  Cross-Correlation 


A-PRIORI  (MDP)  MAPPING  FUNCTION: 
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RESIDUAL  MAPPING  FIT: 
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cure  B.  Weighted  Incorporation  of  Residual  Mapping  Fit 
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7.5  PHOTOGRAMMETRIC  ASPECTS  OF  REMAPPING  PROCEDURES* 

Edward  M.  Mikhail,  Purdue  University  . ^ 

c,-^'  * 

The  presentation  will  discuss  aspects  specific  to  photogrammetry , particularly 
photogrammetric  control  generation.  In  order  to  avoid  having  this  talk  be 
more  or  less  tutorial,  I will,  at  the  end  of  the  talk,  make  the  discussion 
relevant  to  remote  sensing  data  reduction. 

Referring  to  Figure  1,  the  outline,  I will  briefly  go  through  several  aspects 
of  photogrammetry , including  a classical  definition  of  rectification  which 
existed  in  photogrammetry  for  many  years  and  then  show  how  it  changed  tr  fit 
the  context  of  what  we  do  at  present  with  remote  sensing  data.  Since  I was 
specifically  asked  to  discuss  triangulation,  or  at  least  ground  control  gener- 
ation photogrammetrically , I'll  be  talking  a little  bit  about  that  and  tnen  I 
will  go  into  the  MSS  aircraft  data  work  that  we've  been  doing  at  Purdue  at 
least  in  my  area  of  engineering  for  over  seven  years.  At  the  end,  I hope  to 
have  time  to  offer  some  conclusions. 

There  are  broad  definitions  for  photogrammetry.  However,  as  shown  in 
Figure  2,  I'm  going  to  concern  myself  here  with  extracting  information  from 
photographs  and  images  that  are  of  metric  quality.  Fundamentally  a photograph 
or  an  image,  no  matter  which  way  it  is  acquired,  is  basically  a two-dimension- 
al representation  of  a three-dimensional  space.  This  is  shown  schematically 
in  Figure  3 for  a frame  photograph.  If  we  do  not  take  this  fact  into  consid- 
eration, we  are  likely  to  have  problems,  and  I'm  sure  many  of  us  have  'ad 
that. 

In  order  to  recover  the  information  about  the  object,  we  basically  are  going 
in  the  direction  from  where  the  data  was  acquired  back  into  the  object,  and 
the  only  way  we  can  get  the  information  correctly  is  to  do  one  of  two  things. 
Either  to  assume  that  the  object  is  an  average  plane  like  it  was  desired  yes- 
terday by  Fred  Billingsly,  or  we  would  have  to  have  an  external  source  of 
information  about  the  object  itself,  such  as  having  a digital  elevation  model 
as  I will  mention  a little  bit  later. 

Obviously  an  alternative  to  that,  which  is  a typically  photogrammetric  solu- 
tion, is  to  have  more  than  one  ray,  and  there  was  a question,  at  least  one 
raised  yesterday  as  to  what  the  impact  of  having  more  than  one  image  record  is 
on  the  accuracy.  I will  show  some  results  on  that  as  well  later  on.  Figure  4 
is  a schematic  of  three  conjugate  rays  from  three  frame  photographs. 

Rectification,  classically,  was  related  specifically  to  a reprojection,  and, 
in  the  context  of  a frame  photograph,  we  assume  that  it  is  a perspective  pro- 
jection of  a three-dimensional  space,  as  shown  in  Figure  5,  the  original  pho- 
tograph was  oriented  not  necessarily  with  the  optical  axis  of  the  camera 
pointing  downward.  And  what  we  would  like  to  do  is  to  get  another  equivalent 
vertical  photograph  through  a transformation.  The  new  equivalent  photograph 
would  represent  a mean  plane  in  the  terrain  itself.  An  extension  to  this  is 
referred  to  as  differential  rectification  in  photogrammetry  and  requires 
having  more  than  one  photograph.  Figures  6,  7 and  8 show  schema' ics  in  which 
the  terrain  is  represented  with  small  segments,  each  of  which  is  differential- 
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ly  rectified,  that  is  to  say,  now  parallel  to  the  datum  and  then  placed  pro- 
perly  so  that  the  elevation  effect  has  been  taken  into  account.  This  is  the 
procedure  that  produces  the  orthophotos  as  is  known  in  photogrammetry . The 
equivalent  to  that  is  to  consider  a single  image,  either  a frame  perspective 
photograph  segmented  into  small  patches  or,  in  the  case  of  the  MSS  imagery,  to 
consider  each  of  the  pixels  as  if  it  were  a segment.  And  if  you  have  a digi- 
tal elevation  model,  and  if  you  want  a full  rectification  in  the  photogram- 
metric  sense,  then  you  can  merge  these  two  together,  and  you  can  properly 
locate  each  one  of  those  elements  back  relative  to  the  terrain  datum.  I want 
to  say  that  as  far  as  map  projection  is  concerned,  that  does  nothing  other 
than  to  change  the  frame  of  reference  of  the  data.  It  has  absolutely  nothing 
to  do  with  the  fact  that  you  are  going  either  from  three-dimensional  to  two- 
dimensional  or  multiple  two-dimensional  back  to  three-dimensional.  The  map 
projection  is  strictly  a means  of  projecting  the  surface  onto  a map.  So  it*s 
not  the  same  thing  at  all. 

Now,  we  i.iove  on  to  the  triangulation,  which  is  the  procedure  for  getting  con- 
trol. There  is  quite  a lot  of  detail  that  I should  go  through  but  I cannot, 
due  to  lack  of  time.  There  are  different  types  of  procedures  for  triangula- 
tion as  shown  in  Figure  9-  For  our  purposes  here,  the  one  most  commonly  used 
technique  is  analytical  triangulation  where  a lurge  number  overlapping  images 
can  be  simultaneously  reduced  in  such  a manner  as  to  produce  very  high  accur- 
acy control.  The  idea  is  to  have  multiple  rays  for  every  point  on  the  terrain 
for  which  you  require  the  X,  Y,  and  Z location,  as  shown  in  Figure  10,  and  for 
each  of  those  rays,  you  write  the  proper  equations.  And  then  you  reduce  the 
entire  set  of  multiple  rays  simultaneously  in  one  analytical  ^eduction  method. 
Before  you  do  that,  you  need  to  have  at  least  estimates  for  the  unknowns  you 
sought  for. 

Figures  11  and  12  show  situations  which  are  rather  idealized  for  a typical 
block  of  20  aerial  photographs,  and  the  corresponding  structure  of  normal 
equations  used  to  derive  supplementary  control.  The  lower  half  of  Figure  9 
indicates  that  analytical  triangulation  has  reached  a very  high  degree  of  so- 
phistication, Everything  that  enters  the  mathematical  model  is  considered  a 
stochastic  variable  including  the  ground  control  that  is  externally  obtained 
by  ground  means.  And  you  will  enter  the  image  coordinates  as  observable  with 
their  a priori  known  covariance  matrices.  All  the  possible  systematic  errors 
that  occur  are  corrected  according  to  the  best  models  available.  Control  re- 
quirements are:  for  the  horizontal  control,  you  need  it  around  the  perimeter; 
for  the  vertical  control,  you  need  it  well  distributed  through  the  block. 

Figure  13  shows  what  are  called  the  colinearity  equations.  Those  are  for 
frame  photographs  but  can  be  modified  for  a continuous  strip  camera  which  is 
the  exact  equivaler.t  of  the  pushbroom  linear  array;  it  can  be  modified  for 
panoramic  photographs  and  also  for  the  n.  Itispectral  scanner  imagery. 

So  we  have  the  mathematics  to  go  from  regular  photogrammetric  reduction  to  MSS 
reduction.  In  fact,  we  have  done  all  that  at  Purdue,  including  the  block  ad- 
justment of  MSS  data.  I will  show  you  some  results  if  I have  a chance  at  the 
end . 

What  do  we  do  if  we  have  several  hundred  photographs  and  for  each  of  the  pho- 
tographs, there  are  six  unknowns.  We  end  up  with  a very  large  system  of  line- 
ar equations,  actually  they  are  originally  nonlinear,  but  are  linearized.  We 
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take  advantage  of  the  characteristics  of  the  normal  equation  structure  which 
is  very  sparsely  populated  by  nonzero  elements  as  shown  in  Figure  17.  We  also 
take  advantage  of  techniques  of  folding  parts  of  this  matrix  in  sue’  a way 
that  we  end  up  with  only  a subset  of  the  unknowns,  and  it  gives  us  a banded 
bordered  structure  of  matrices  which  are  relatively  efficiently  reduced. 

So  what  do  we  get  from  the  analytical  triangulation  scheme?  Well,  we  will 
basically  get  X,  Y and  Z for  all  points  of  interest  for  which  we  had  input 
image  coordinates,  based  on  a skeleton  of  control  points  around  the  perimeter 
and  a few  in  the  center.  As  regards  accuracy,  working  with  frame  photography, 
and  this  of  course  may  probably  look  out  of  context  here,  we  can  go  down  to 
three  micrometers  at  the  plane  of  the  image  for  the  control  that  we  have  ob- 
tained from  aerial  photography  (Figure  9). 

The  last  section  of  this  talk  briefly  covers  work  we  did  at  Purdue.  Three 
papers,  listed  as  references,  will  briefly  be  discussed.  Figure  14  shows  the 
detailed  outline  for  the  first  paper,  essentially  a survey  paper  giving  the 
mathematical  models  we  use  when  we  actually  deal  with  MSS  images  as  if  they 
were  photogrammetric  blocks  of  photographs.  The  idea  is  that  for  each  one  of 
the  locations  of  the  sensor  you  would  have  nominally  six  parameters  describing 
its  location  and  attitude.  This  would  lead  to  six  parameters  per  pix'l  if  we 
treat  the  problem  in  a vigorous  manner,  which  would  lead  to  a very  la.  ge  num- 
ber which  would  be  impossible  to  reduce  (see  Figure  15).  For  the  case  of  the 
pushbroom  scanner,  we  have  six  parameters  for  each  line.  For  practical  pur- 
poses we  segment  the  image,  and  consider  each  segment  as  if  a photograph  had 
six  elements  (Xc,  etc.).  We  then  consider  each  of  those  elements  as  if  it 
were  a function  of  time.  There  is  a large  number  of  possibilities  with  wl  ioh 
we  actually  model  the  exterior  element  and  I have  several  of  those  already 
mentioned  in  those  papers.  There  are  two  basic  techniques:  either  to  specifi- 
cally model  everything  we  know  about  the  sensor,  or  to  use  some  interpretive 
technique  in  order  to  get  the  information. 

Another  important  aspect  is  to  consider  whether  we  want  to  work  with  only  sin- 
gle images  which  have  the  limitation  of  considering  only  horizontal  (or  X,  Y) 
information,  or  we  will  work  with  the  block  adjustment  which  then  gives  us 
also  the  Z.  In  consideration  of  the  Z,  there  are  two  ways  of  looking  at  this 
problem:  either  using  the  remoue  sensing  data  for  mapping  purposes,  or  for  the 
purpose  of  merging  the  MSS  information  to  other  sources  of  data,  which  would 
require  only  rectification.  You  want  to  rectify  it  but  not  use  it  for  mapping 
as  such.  So  everything  Roy  Welch  said  yesterday  was  to  meet  map  accuracy 
standards  as  if  the  MSS  or  its  equivalent  (whatever  the  sensor  used)  actually 
does  the  topographic  mapping  at  appropriate  scale.  What  I am  saying  here  is 
related  to  the  need  to  rectify  the  date  so  that  you  may  derive  other  tyres  of 
information  from  it. 

Figure  16  shows  the  single  coverage  results.  One  of  the  things  that  we  did  is 
to  take  r strip  of  MSS  imagery  and  segment  it,  write  constraints  between  seg- 
ments so  tr.at  continuity  is  preserved.  As  the  number  of  segments  increases, 
the  check,  or  whac  ever  measures  you  have  for  accuracy,  would  improve  up  to  a 
certain  point  and  after  that,  of  course,  it  levels  off  because  the  degrees  of 
freedom  are  reduced  (see  Figure  17).  Using  real  data  from  three  sidelapping 
strips,  the  Z is  indeed  recoverable  (see  Figure  18).  I don't  know  if  the  gen- 
tleman who  asked  the  question  yesterday  regarding  the  use  of  ste~eo  is  here  or 
not  but  he  was  wondering  what  would  happen  if  you  use  overlapping  imagery. 
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This  not  only  produces  the  Z but  it  also  improves  the  recovery  of  ‘orizontal 
coordinates  by  40  and  60S  as  shown  in  Figure  19.  There  are  other  aspects  o* 
this  work,  namely  that  you  could  adapt  techniques  from  the  block  adjustment  of 
photographs  to  be  used  with  MSS.  Notably,  we  have  used  geometric  constraints 
such  as  points  lying  on  straight  lines  (e.g.,  roads).  The  use  of  such  con- 
straints can  replace  the  need  for  control,  or  if  used  in  addition  to  control, 
can  lead  to  improved  accuracy. 

In  conclusion,  we  feel,  in  photogrammetry,  that  we  were  not  really  heeded  as 
much  as  we  ought  to  have  been;  there's  a wealth  of  information,  a wealth  of 
technology  that  is  useable  with  remcte  sensing  imagery.  Everything  I’ve  said 
here,  of  course,  relates  to  aircraft  MSS  data  which  is  the  one  thing  I had 
continued  to  work  with.  We  have  not  the  equivalent  tning  with  Land  sat  for 
obvious  reasons  It  was  a tremendous  jump  to  go  from  the  micrometer  level  to 
the  80-meter  resolution,  so  I stayed  with  the  aircraft. 

I feel  that  I have  just  scratched  the  surface  as  far  as  the  actual  remapping 
topic.  However,  I hope  that  this  with  reference  papers  w d g.'- e you  a good 
idea  of  what  can  be  gained  when  photogrammetric  technology  is  considered  when 
rectifying  and/or  registering  remote  sensing  data. 
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Figure  3.  Object  Space  and  Exterior  Orientation 
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Figure  4.  Scale  Restraint  Equation 
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Figure  6.  Methods  of  differential  rectification  (a)  Terrain  ^nd 
corresponding  contour  map  (b)  Fixed  line  element  strip  rectification 
(c)  Rotating  line  element  strip  rectification  (d)  Plane  area  element 
rectification  ( e ) Curved  area  element  rectification  After  Edmond.  Bendu 
Technical  Journal.  Vol  1.  No  2,  1968 
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PURPOSE:  To  Generate  Extensive  Control  Net  From  Overlapping  Photographs 
and  a Few  Control  Points 
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ADAPTATION  OF  TRIANGULATICN  TECHNIQUES  TO  MSS 
Figure  9.  Photogramme  trie  Tri angulation 
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Figure  11.  Arrangements  of  Points  in  E51 


3 


Normal  Equatic-  Matrix  Arising  From  Application  of 
Col  linearity  Equations  to  a 4 Strip  - 20  Photo  Block 
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Figure  16.  Single  Coverage  Data  (E/M) , Cheek  point  RMSE  (Pixels) 
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COMPUTATIONAL  ASPECTS  OF 
REMAPPING  DIGITAL  IMAGERY 


Albert  L.  Zobrist 
Jet  Propulsion  Laboratory 
Pasadena,  CA  91103 


1-  Introduction 

One  of  the  advantages  of  automated  cartography  is  that  map  data  stored  in 
the  digital  computer  can  be  plotted  or  displayed  at  any  scale  or  projection  by 
recomputing  the  coordinates  of  the  data*  This  is  especially  easy  in  the  case 
of  vector  (graphics)  data  but  in  the  case  of  digital  image  (raster)  data, 
remapping  is  a more  difficult  operation.  Examples  of  the  remapping  of  digital 
imagery  would  include  rectification  of  a Landsat  MSS  to  an  orthographic  or 
Mercator  projection,  warping  of  one  image  to  register  with  another,  or 
rotation,  scale,  or  aspect  changes  of  a digital  image.  Inputs  consist  of  the 
digital  image  and  geometric  control  information.  Control  information  can 
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include  scanner  location  and  pointing,  ground  truth,  and  the  map  transfor- 
mation. Digital  remapping  consists  of  two  major  steps.  First,  a distortion 
model  is  computed  from  the  control  information.  Second,  the  image  is  warped 
according  to  the  distortion  model. 

The  first  slop  involves  traditional  mathematical  techniques  of  estimating 
a surface  from  sample  points.  Several  approaches  persist  because  of  varying 
needs  of  different  applications.  The  second  step  involves  highly  specialized 
computational  methods  for  efficient  warping  of  large  images  according  to  a geo- 
metric distortion  model.  Use  of  general  purpose  computers  and  array  processors 
for  this  task  will  be  covered.  Data  processing  error  will  be  discussed  for 
each  modelling/warping  approach. 

2.  Determination  of  geometric  distortion  model 

Mathematically,  a geometric  distortion  is  a mapping  from  the  plane  ? to 
the  plane.  The  mapping  is  usually  one-to-one  and  continuous  but  there  may  be 
discontinuities.  Orthogonal  components  of  the  mapping  (the  x and  y coordin- 
ates) are  independent  and  each  can  be  viewed  as  a surface  over  the  plane.  For 
a point  p,  the  value  of  the  x-distortion  surface  at  p specifies  how  far  the 
data  at  p must  move  in  the  x direction  in  the  remapping.  Some  simple  geometric 
distortions  are  used  to  rotate  images  or  change  pixel  size.  In  this  case  the 
general  transformation  is  called  affine  or  linear  and  the  x and  y components 
are  planes.  Map  coordinate  conversions  (for  example  UTM  to  Transferse  Mer- 
cator) are  given  by  formulas  which  can  also  be  viewed  as  distortion  surfaces 
over  a plane.  Singularities  and  zone  boundaries  are  not  a problem  here  but 
are  dealt  with  in  sectioning  images  for  a data  base. 
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A more  complex  geometric  distortion  problem  is  the  "rubber  sheet"  case 
where  a set  of  control  points  relating  the  input  to  the  output  is  known.  A 
number  of  techniques  are  known  for  generating  surfaces  to  fit  the  control 
points  and  give  a distortion  model  over  the  entire  surface.  Some  are  general 
in  nature:  polynomial  fit,  nearest-neighbor  interpolation,  finite  element 

method,  and  the  method  of  potential  functions.  These  are  used  in  cases  where 
there  is  no  need  or  desire  to  use  a priori  knowledge  of  the  nature  of  the  geo- 
metric distortion.  If  one  knows  (from  physical  considerations)  the  general 
functional  form  of  a distortion,  then  there  are  methods  (least  squares,  Kalman 
filtering,  etc.)  of  fitting  the  functional  form  to  the  obs  rvations.  Table  1 
compares  some  basic  properties  of  these  methods. 

The  most  complex  distortion  models  arise  from  sensor  geometry  correction. 
Taking  the  Landsat  MSS  to  be  a basic  example,  the  raw  data  are  perturbed  by 
earth  rotation,  mirror  scan  nonlinearity,  spherical  earth,  variations  in  plat- 
form altitude,  roll,  pitchy  and  yaw.  Most  of  these  components  can  be  modelled 
by  continuous  functions,  but  one  component,  the  line-to-line  skew  induced  by 
earth  rotation  is  discontinuous  at  every  sixth  line.  Furthermore,  the  distor- 
tion model  is  no  longer  a simple  function  but  a composite  of  several  functions 
that  are  applied  in  order.  The  first  correction  function  calculates  uniform 
sample  spacing  in  orthographic  or  Mercator  projection  along  single  scan  lines. 
Then  a second  correction  function  moves  entire  lines  according  to  the  sensor 
and  earth  rotation  skew  for  each  line.  A third  correction  for  map  projection 
could  now  be  performed  if  desired.  Two  basic  techniques  for  model  fitting  are 
in  common  use  today.  The  first  is  to  use  nominal  values  for  spacecraft  loca- 
tion, etc.,  and  produce  a corrected  product  which  has  slight  deviations  from  a 
perfectly  mapped  product.  Note  that  the  largest  deviation  is  a simple  lateral 
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translation,  which  can  be  fixed  later  by  a single  point  observation*  The 
second  technique  is  to  fit  the  model  according  to  control  points  determined  by 
external  means*  These  methods  are  covered  in  other  reports  in  this  workshop* 

3*  Representation  of  geometric  distortion  model 

Digital  computation  requires  that  the  geometric  distortion  be  represented 
in  an  efficient  manner.  Three  methods  are  covered  here.  The  first  method  is 
to  leave  the  model  in  its  functional  or  natural  form.  Model  fitting  provides 
coefficients  or  data  for  a subroutine  F which  can  be  invoked  at  a point  p to 
give  the  distortion  F(p).  The  second  method  is  to  convert  the  model  to  a 
gridded  approximation.  A rectangular  grid  a^,  a^2>  a2i>  amn 

is  set  up  and  the  subroutine  F is  calculated  at  these  points*  The  values  a^ 
and  F(aij)  are  stored  in  a data  structure  so  that  the  value  F(p)  can  be  gen- 
erated by  interpolation  in  an  efficient  manner.  The  third  method  is  a Highly 
specialized  one  for  scanner  type  data  such  as  MSS.  In  cases  where  some  compon 
ents  of  F are  functions  of  one  variable  (separable  components)  a "dope  vector" 
can  be  set  up  to  represent  the  shift.  As  an  example,  the  mirror  scan  nonlin 
arity  is  a function  of  position  along  a scan  line  only.  A dope  vector  oi  the 
same  length  as  a scan  line  can  represent  this  correction  on  a per  pixel  basis. 
Earth  skew  offset  and  sensor  readout  delay  can  be  represented  by  a dope  vector 
with  a per  line  lookup.  Both  of  these  corrections  are  "along  track",  that  is, 
in  the  direction  of  scanning.  It  is  possible  to  have  dope  vectors  for  across 
track  corrections  as  well,  if  needed. 

Direct  computation  of  F for  each  pixel  is  a slow  method,  although  it  may 
be  helped  by  array  processor  techniques.  Gridded  representation  offers  great 
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speedup  simply  because  a 50  x 50  grid,  for  example,  requires  a factor  of  3072 
times  fewer  evaluations  of  F than  a 2400  by  3200  image  would  by  direct 
computation.  Gridding  introduces  a data  processing  error,  however  (see  later 
section  on  error).  In  general,  discontinuous  functions  and  functions  which 
are  not  approximated  well  by  interpolation  on  a grid  are  poor  candidates  for 
gridding.  Dope  vectors  can  only  be  used  on  separable  functions,  of  course. 

A special  strategy  for  MSS  involves  a combination  of  dope  vectors  to:  the 
discontinuous  and  highly  nonlinear  elements  of  F and  a gridded  approximation 
for  the  remainder.  Evaluation  at  F(p)  would  involve  several  table  lookup  oper- 
ations in  the  dope  vectors  followed  by  the  grid  interpolation. 

4.  Large  image  warping  computation 

Regardless  of  method,  the  remapping  of  a digital  image  can  be  an  enormous 
computation.  For  example,  an  MSS  input  contains  over  seven  megabytes  of  data 
per  spectral  band  and  yields  over  ten  megabytes  of  data  for  57-meter  square 
pixels.  Executing  ninety  machine  instructions  per  output  pixel  at  one  micro- 
second per  instruction  would  occupy  about  16  minutes  of  processor  time.  Yet 
this  slim  number  of  cycles  must  accomplish  the  following: 

(1)  For  each  output  pixel,  calculate  the  location  of  the  input  point 
that  maps  to  it  (the  inverse  of  the  mapping). 

(2)  For  each  output  pixel,  calculate  the  pixel  value  based  on  inter- 
polation of  input  pixel  values  neighboring  the  input  point. 

(3)  Buffer  the  input  and  output  so  that  a reasonable  main  memory  region 
can  accommodate  the  calculation  without  excessive  disk  head  motion 
or  file  rereading. 
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Computational  aspects  of  these  steps  for  an  ordinary  digital  computer  will  be 
covered  in  order ♦ 

The  first  step  requires  that  for  an  output  pixel  location  p and  an  inverse 
mapping  F that  F(p)  be  calculated.  If  F is  a composite  function,  then  each 
component  must  be  calculated  in  order.  Functions  represented  by  formula  are 
evaluated  by  their  subroutine.  There  are  some  opportunities  for  speeding  up 
function  evaluation,  for  example,  by  use  of  table  lookup  for  parts  of  a func- 
tion (such  as  a cosine).  Another  example  is  incremental  evaluation  where 
F(x  + dx)  * F(x)  + G(x,dx) 

and  G(x,dx)  is  faster  to  compute  than  F(x).  A concrete  example  of  this  is 
cos(x  + dx)  = cos  x cos  dx  - sin  x sin  dx 
so  for  uniform  dx  a cosine  can  be  calculated  with  two  multiplies  and  an  add, 
assuming  that  sin  x is  maintained  in  a similar  fashion.  The  incremental  evalu- 
ation can  even  be  an  approximation  if  care  is  taken  to  restart  with  an  exact 
evaluation  frequently  enough  to  limit  the  error  to  an  acceptable  range.  Func- 
tions represented  by  a grid  are  amenable  to  a much  faster  treatment.  Within 
each  grid  cell  an  incrementing  scheme  can  be  set  up  consisting  of 

F(x  ,y  ) an  initial  point 

o*Jo  r 

Ax 

A y increments 

A xy 

which  allow  for  recalculation  of  F for  a series  of  increments  in  the  x direc- 
tion 

F(x  + dx,y)  * F(x,y)  +Ax 
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and  for  a move  to  the  next  line  of  output 


F(x,y  + dy)  * F(x,y)  +Ay 
Ax  =Ax  +Axy 

This  corresponds  to  bilinear  interpolation  on  the  grid*  If  non-uniform  incre- 
ments are  needed  because  of  function  composition,  additional  multiplications  b 
dx  and  dy  will  be  required.  When  dope  vectors  are  used  it  is  usually  accurate 
enough  to  use  the  correction  value  from  the  nearest  pixel.  As  an  example,  the 
along-track  correction  for  an  across  track  dope  vector  is 
F(x,y)  * x + D(round  (y)) 

One  special  problem  arises  from  discontinuities  in  the  mapping  function.  For 
purposes  of  pixel  value  interpolation,  it  is  necessary  to  know  about  local 
discontinuities  in  the  neighborhood  c F(x,y).  Hence  for  cubic  spline  inter- 
polation for  MSS  a point  (x,y)  maps  into  four  locations  for  four  lines  which 
are  offset  from  each  other.  Fortunately  in  this  case,  the  samples  are  uni- 
formly spaced  (Figure  1). 

The  second  step  of  warping  computation  is  the  actual  interpolation  for 
the  output  pixel  value  from  the  neighboring  input.  Methods  for  this  are  dis- 
cussed elsewhere  in  the  workshop. 

The  third  problem  involves  the  allocation  of  limited  main  storage  to  stor- 
age of  a part  of  the  raster  input  so  that  the  raster  output  can  be  computed 
efficiently.  Two  previous  methods  did  not  work  well  for  large  or  highly 
rotated  input  rasters  (for  example  3000  x 3000  rotated  11°).  Method  1 
stores  a band  of  raster  lines  internally  as  shown  in  Figure  2.  Because  of 
rotation  an  output  line  will  only  have  a short  intersection  with  this  band. 
Therefore,  it  is  only  possible  to  calculate  an  extremely  large  number  of  short 
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output  segments  which  nius  be  written  to  disk  and  later  reconstructed  into  the 
output  raster.  The  later  reconstruction  involves  excessive  disk  head  motion 

for  large  cases.  If  the  raster  is  n by  n and  available  storage  is  fixed,  then 

2 

the  length  of  calculated  segments  is  0(l/n),  the  number  of  cells  is  0(n  ), 

3 

hence  the  number  of  short  segments  is  0(n  ) and  disk  head  motion  will  in- 
crease by  this  factor  under  a simple  reconstruction  scheme.  Method  2 avoids 
the  reconstruction  of  short  segments  by  storing  all  of  the  input  raster  in  the 
neighborhood  of  an  output  line.  But  because  the  stored  input  area  is  not  a 
band,  the  input  file  must  be  reread  as  many  times  as  there  are  plateaus  in  the 
lower  part  of  the  stored  area.  The  thickness  of  the  stored  area  is  0(l/n)  and 

the  length  of  the  line  is  0(n)  hence  the  number  of  rereads  of  the  input  data 
2 2 

set  is  0(n  ).  Since  the  amount  of  data  is  0(n  ) the  disk  head  motion  will 
increase  by  0(n  ).  The  new  method  developed  computes  a uniform  vertical  band 
of  optimal  width  in  the  output  by  storing  a corresponding  swath  of  input.  The 
output  segment  width  is  independent  of  n hence  disk  motion  depends  on  the  num- 
ber of  times  the  input  has  to  be  read  which  is  0(n)  times  amount  of  data  yield- 
3 2 

ing  0(n  ).  The  reconstruction  stage  is  0(n  )•  Thus  method  2 is  unsuitable 
for  large  cases  and  methods  1 and  3 appear  the  same.  A closer  analysis  reveals 
that  method  1 forces  a head  motion  for  sequential  passes  over  the  data  which 
minimizes  head  motion  and  rotation  latency.  Methods  1 and  3 are  implemented 
in  the  VICAR  routines  LGEOM  and  MGEOM  respectively,  and  method  2 was  reported 
by  H.  K.  Ramapriyan  (1977). 

Unusual  approaches  to  this  problem  have  been  proposeu.  One  is  to  resample 
horizontally,  rotate  the  image  90°  and  then  resample  vertically  (which  is 
horizontal  after  rotation).  Good  methods  for  90J  rotation  are  available 
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(Twogood  and  Ekstrom,  1976)  • Resampling  techniques  and  experimentation  are 
reported  by  Friedmann  (1981). 

5.  Data  processing  error 

Image  registration  and  rectification  error  analysis  is  the  subject  of 
another  report  in  this  workshop.  Therefore,  model  errors  vilJ  not  be  con- 
sidered here.  Data  processing  error  includes  only  the  error  introduced  in  the 
following  ways: 

(1)  errors  in  calculation  of  the  inverse  mapping  F(x,y) 

(2)  errors  introduced  by  interpolation  on  a grid  or  dope  vector 
representation  of  F(x,y) 

(3)  errors  in  the  location  of  neighboring  pixels  of  F(r  y)  for  input 
to  the  interpolation  scheme. 

There  may  also  be  error  in  the  interpolation  scheme,  but  this  is  not  a location 
error,  with  regard  to  the  three  errors,  note  that  a 1/10  pixel  error  on  a 3000 
x 3000  image  requires  an  accuracy  of  one  part  In  30,000.  Griddin^  methods  are 
the  most  difficult  to  hold  within  such  an  error  budget.  One  component  of  grid 
error  is  th-?  deviation  of  the  bilinear  surface  from  the  model  surface.  A 
second  component  is  accumulative  error  in  the  incrementing  scheme  described  in 
the  last  sections.  Both  of  these  errors  are  controlled  by  keeping  the  grid 
size  small.  The\accumuiative  error  necessitates  the  use  of  computer  arithv^ic 
with  greater  precision  than  3>or  36- bit  floating  point. 
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® INVERSE  MAPPED  LOCATION  OF  OUTPUT  PIXEL 
x CENTERS  OF  INTERPOLATION  ALONG  A LINE 
• INPUT  PIXELS  USED  IN  81-CUBIC  SPLINE  INTERPOLATION 

Figure  1.  Interpolation  in  the  Presence  ot  Discontinuities  in  Input  Data 
Along  a Line 
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7.7  A QUANTITATIVE  ASSESSMENT  OF  RESAMPLING  ERRORS 


Robert  H.  Dye 
Applications  Division 

The  Environmental  Research  Institute  of  Michigan 
Ann  Arbor,  Michigan,  48107 


INTRODUCTION 


Applications  associated  with  digital  geographic  imagery  are 
subject  to  great  diversity  in  required  cell  size,  carto- 
graphic projection,  etc.  The  need  for  resampling  remote 
sensing  scanner  data  is  evident  in  all  but  the  most  unde- 
manding cases.  Past  efforts  [1]  have  shown  that  proper  re- 
sampling of  such  data  is  dependant  in  important  ways  on  the 
detailed  knowlege  of  the  original  scanner's  effective 
point-spread  function  and  to  the  desired  point-spread  func- 
tion of  the  resampled  data.  When  both  of  these  are  known, 
it  is  relatively  straightforward  to  compute  the  resampling 
coeffients  which  do  the  best  job  of  approximating  the  shape 
and  position  of  the  synthesized  point-spread  function. 

It  is  useful,  however,  to  recognize  that  regardless  of  the 
rationale  used  to  generate  interpolation  coefficients  and 
apply  them  as  a linear  filter  on  a subset  of  the  local  data 
the  result  can  be  viewed  as  a synthesis  of  a new  point 
spread  function  which  is  itself  a linear  combination  of 
shifted  positions  of  the  original  psf. 

The  resulting  synthesized  psf  can  be  compared  with  an  ideal 
psf  located  at  various  interpixel  positions  and  any  differ- 
ences observed  as  errors. 
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ERROR  MODEL 


It  is  assumed  that  imaging  scanners  of  interest  are  ade- 
quately modeled  as  a linear  operator  on  the  upwelling  radi- 
ance and  that  additive  noise  is  introduced.  (The  LANDSAT 
MSS  does  deliberately  introduce  a non-linear  compression 
prior  sampling  but  this  effect  is  approximately  removed  in 
subsequent  ground  processing.)  Thus,  the  scanner  to  be  mo- 
deled is  given  by 

y=  Ax  + n (1) 

where  x is  a vector  representing  the  two-dimensional  upwel- 
ling radiance,  A is  a matrix  describing  the  two-dimensional 
shape  and  location  of  the  psf  associated  with  each  pixel 
sampled.  The  noise  vector  n is  then  added  to  produce  the 
data  vector  y which  can  represent  either  all  of  the  pixels 
in  an  image  or  only  those  in  a locality  of  interest. 

It  should  be  noted  that  the  dimensionality  of  x is  very  much 
greater  than  that  of  y in  order  to  permit  the  A matrix  to 
represent  the  sufcpixel  detail  of  the  point  spread  functions 
and  the  effect  of  the  dimensionality  reducing  sampling  pro- 
cess. 

When  an  interpolation  algorithm  is  used  in  the  resampling 
process  it  is  normally  intended  to  estimate  the  data  value 
that  might  have  been  obtained  from  a psf  positioned  at  an 
intermediate  location  between  the  existing  samples. 

The  desired  result  of  the  resampling  process  thus  can  be 
given  by 

z = Bx  (2) 

where  B is  a new  spatial  responsivity  matrix  with  the  point 
spread  functions  positioned  correctly  on  the  desired  output 
grid  and  the  vector  z represents  the  resampled  data.  Note 
that  the  width  and  snape  of  the  psf's  in  B need  not  be  the 
same  as  that  of  the  original  scanner  when  it  is  desireable 
to  alter  the  spatial  resolution  of  the  data  as  well  as  the 
location. 
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Restricting  the  interpolation  process  to  a linear  filter  op- 
erating on  the  available  data  leads  to  an  approximation  of 
the  desired  scanner  in  (2)  given  by 


A 

z=  Cy 


0/ 


z = {Lk)x  + Cn  (3) 


in  which  the  interpolation  coefficients  C and  the  original 
psf  matrix  combine  to  produce  a new  psf  matrix  CA  having 
spatial  resolution  properties  which  can  be  either  better  or 
worse  than  the  original  depending  cn  the  method  used  to  de- 
termine the  coefficients. 

Any  differences  between  the  desired  scanner  (2)  and  the 
achieved  scanner  (3)  can  be  regarded  as  an  error  given  by 


e=  z - z (4) 


The  mean  squared  error  is  easy  to  compute  and  relatively 
easy  to  defend  as  a performance  criterion  particularly  for 
processes  such  as  classification  which  may  be  sensitive  to 
radiometric  errors.  The  mean  squared  error 


E = <e ' e>  (5) 


can  be  evaluated  by  substituting  (2), (3),  and  (4)  into  (5). 
The  result,  after  the  elimination  of  terms  with  expected 
value  of  zero  is 


E=  Trace  [CA<xx ' >A ' C 1 -2CA<xx ' >B ' +B<xx * >B 1 +C <nn ' >]  (6) 
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This  expression,  when  evaluated  for  various  rules  and  inter- 
pixel positions  yields  the  data  shown  in  Table  1.  The  rules 
used  were  nearest-neighbor,  bilinear,  cubic  convolution,  and 
least  square.  The  LANDSAT  along-scan  psf  was  used  for  ma- 
trix A and  a rectangular  psf  with  a width  of  50  meters  was 
chosen  for  the  desired  psf  matrix  B.  A signal -to-noi se 
ratio  of  ten  was  selected  which  established  a ratio  of  100 
between  the  signal  covariance  matrix  <xx'>  and  the  noise  co- 
variance  matrix  <nn‘>.  Finally,  to  restrict  the  error  de- 
termination to  the  case  of  very  fine  local  detail  the  sub- 
pixel correlations  were  set  to  zero  by  use  of  scalar  ma- 
trices for  <xx‘>  and  <nn‘>. 

The  numbers  tabulated  are  relative  errors,  giving  a maximum 
of  100  for  the  worst  possible  case  of  no  corresponance  at 
all  between  psf  matrices  (CA)  and  B.  The  relative  error  is 
defined  as 


r.e.=  100  SQRT (E/2B,<x'x>B)  (7) 


The  algorithms  for  generating  coefficients  for  the  first 
three  interpolation  rules  are  well  known  and  will  not  be  re- 
peated here.  The  least  square  coefficients  are  obtained 
from 


C=  B<xx ' >A ' [A<xx ' >A 1 +<nn ' >] 


(8) 


In  the  table,  positions  1 and  17  correspond  to  the  cases  of 
the  desired  psf  falling  exactly  on  one  of  the  original  data 
sarnies.  All  others  are  located  at  interpixel  locations 
differing  by  multiples  of  1/16  of  a pixel. 

All  four  methods  show  the  worst  error  near  the  center  of  the 
interpixel  interval  where  a narrow  psf  is  the  most  difficult 
to  synthesize-  that  it  is  not  the  exact  center  is  due  to  the 
asymmetry  introduced  by  the  lowpass  presampling  filter  used 
in  the  LANDSAT  MSS. 
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It  is  recoqm..ed  that  all  of  the  errors  might  be  regarded  as 
undesirably  large.  Had  the  sampling  rate  been  even  slightly 
better  than  the  56  meters  used  the  errors  for  IS  would  have 
been  substantially  reduced  while  the  errors  for  the  other 
methods  would,  of  course,  remain  unchanged. 

To  explore  in  the  other  direction,  the  case  of  wider  synthe- 
sized psf's  may  be  considered.  Such  resolution-reducing  re- 
sampling would  be  the  preferred  method  for  the  generation  of 
large  area,  small  scale  images.  As  the  desired  psf  is  in- 
creased in  width  the  errors  for  all  four  methods  would  de- 
crease until  an  approximate  match  with  the  original  psf  is 
reached.  After  this  the  LS  error  would  continue  to  decrease 
while  the  other  three  errors  would  increase  again  because  of 
their  failure  to  synthesize  a psf  suited  to  the  resampling 
i nterval . 

As  should  be  expected  NN,  BL,  and  CC  all  have  the  same  error 
at  positions  1 and  17  since  all  three  merely  reproduce  the 
original  data  when  no  interpolation  is  required.  By  con- 
trast, the  LS  solution  has  synthesized  a psf  more  closely 
approximating  the  desired  psf  and  hence  exhibits  a smaller 
error.  The  largest  error  occurs  for  NN  at  position  8,  where 
the  psf  is  not  only  the  wrong  shape  and  width  but  also  in 
the  wrong  place  by  a half  pixel.  Perhaps  it  could  be  ob- 
served that  the  BL  and  CC  algorithms  do  rather  well  for  pro- 
cedures which  provide  no  opportunity  introduce  information 
about  the  original  and  desired  psf's  and  the  signal  and 
noise  statistics. 

Another  measure  of  image  quality  is  the  modulation  transfer 
function.  Although  the  MTF  is  merely  the  magnitude  of  the 
Fourier  Transform  of  the  psf  and  hence  carries  less  informa- 
tion than  the  psf  itself,  it  frequently  invoked  when  image 
quality  is  considered.  The  normalized  width  at  the  half  am- 
plitude of  the  MTF  at  positions  1 and  8 for  each  resampling 
scheme  is  snown  in  Table  2.  It  can  be  seen  that  LS  shows  a 
broader  MTF  than  the  other  methods  for  both  positions  and 
that  both  BL  and  CC  have  degraded  MTF's  at  the  midpixel  lo- 
cation . 


[1]  R.  Dye,  "Restoration  of  LANDSAT  Images  by  Discrete 
Two-Dimensional  deconvolution".  Proceedings  of  the  Tenth 
International  Symposium  on  Remote  Sensing  of  the  Environ- 
ment. ERIM,  Ann  Arbor, MI,  October  1975. 
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TABLE  1.  RELATIVE  ERRORS  FOR  VARIOUS  INTERPIXEL 
POSITIONS 


POSITION 

NN 

BL 

CC 

LS 

1 

40.1 

40.1 

40.1 

34.6 

2 

41.4 

41.8 

40.7 

35.9 

3 

43.1 

43.4 

41.5 

37.4 

4 

45.3 

44.9 

42.4 

38.7 

5 

47.7 

46.1 

43.2 

39.8 

6 

50.4 

47.0 

43.8 

40.4 

7 

53.2 

47.5 

44.1 

40.6 

8 

56.0 

47.7 

44.2 

40.2 

9 

49.8 

47.5 

43.9 

39.4 

10 

47.1 

47.0 

43.4 

38.2 

11 

44.6 

46.1 

42.7 

36.8 

12 

42.5 

45.1 

41.9 

35.3 

13 

40.9 

43.9 

41.1 

34.1 

14 

39.8 

42.6 

40.5 

33.2 

15 

39.3 

41.5 

40.0 

33.0 

16 

39.4 

40.6 

39.9 

33.3 

17 

40.1 

40.1 

40.1 

34.3 

TABLE  2.  RELATIVE  WIDTHS  OF  MODULATION  TRANSFER 
FUNCTIONS 


POSITION 

NN 

BL 

CC 

LS 

1 

100.0 

100.0 

100.0 

142.6 

9 

100.0 

76.6 

95.0 

127.8 

( 
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7.8  GEOMETRIC  ERROR  CHARACTERIZATION  AND  ERROR  BUDGETS* 


Eric  Beyer,  General  Electric 


This  discussion  describes  the  procedures  used  in  characterizing  geometric 
error  sources  for  a spaceborne  imaging  system,  and  uses  the  Landsat-D  Thematic 
Mapper  ground  segment  processing  as  the  prototype.  It  should  be  noted  that 
software  has  been  tested  via  simulation  and  is  currently  going  through  tests 
with  the  operational  hardware  as  part  of  the  operational  system  evaluation 
prelaunch,  so  that  we  cun  thoroughly  characterize  this  system  with  respect  to 
its  geometric  performance  before  we  launch  it.  In  addition,  there  is  a sub- 
stantial effort,  both  on  the  part  of  General  Electric  and  NASA-Goddard  in 
postlaunch  evaluation  of  this  data.  With  respect  to  geometric  performance  and 
radiometric  performance  the  requirements  for  this  system  are  being  taken  very 
seriously. 


There  are  two  requirements  for  Landsat-D  Thematic  Mapper  as  well  a pro- 
cessing, which  relate  to  the  geodetic  accuracy.  Figure  1 displays  i ;cess 
whereby  we  can  match  back  to  a standard  map  as  well  as  provide  temper  .is- 
tration,  and  band-to-band . There  are  some  significant  caveats  in  these  areas 
which  are  important  to  the  users.  For  one,  Landsat  is  not  a mapping  system, 
we  don't  view  it  that  way.  We  are  providing  a system  that  will  meet  certain 
geodetic  rectification  requirements  if  we  are  provided  maps  that  have  no 
errors  in  them.  That  obviously  is  not  the  case.  Therefore,  much  of  the  at- 
tention it:  Landsat-D  has  been  directed  towards  temporal  registration.  That  is 
we  want  to  be  sure  that  we  are  self-consistent,  that  our  images  will  overlay 
with  high  accuracy. 

The  requirements  for  geodetic  registration  is  .5  pixel,  again  with  its  major 
caveat,  and  there  is  another  caveat  which  has  to  do  with  adequate  numbers  of 
ground  control  points.  One  other  that  says  this  is  to  be  done  without  consid- 
eration of  topographical  variations.  Thus,  this  is  the  performance  expected 
if  you  have  a flat  earth  for  temporal  registration  and  the  ground  track  and 
attitude  control  of  the  spacecraft  were  exactly  repeatable  past  to  past. 
There  has  been  very  little  concern  about  band-to-band  accuracy  with  the  multi- 
spectral  scanner,  mostly  because  due  to  its  design  it  has  exceedingly  good 
band-to-band  accuracy.  Once  you  get  the  focal  plane  base  plate  properly  de- 
signed along  with  the  scanning  mechanism,  there  is  very  little  opportunity  for 
band-to-band  misregistration  with  the  MSS.  The  Thematic  Mapper  has  a much 
larger  spread  to  its  detectors  and  much  larger  time  between  various  bands 
being  imaged,  so  there  is  much  more  opportunity  for  band-to-band  registration 
errors.  As  Jack  Engel  has  pointed  out,  the  current  instrument  has  very  good 
band-to-band  accuracy.  There  are  features  in  the  ground  processing  that  will 
significantly  improve  that.  For  the  Thematic  Mapper  after  processing,  it 
should  be  possible  to  achieve  something  well  down  belo^  a 10th  of  a pixel 
band-to-band  accuracy. 


The  single  scene  accuracy  requirement  can  be  characterized  as: 


•Edited  oral  presentation. 
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= 3.9  METER  (1  ) 

We  are  essentially  dealing  then  with  the  Gaussian-type  error  performance,  so  I 
can  convert  one-to-one  sigma  by  the  Gaussian  transformation  90S  to  one  sigma 
for  temporal  registration.  Given  we  ^o  our  processing  down  to  the  point  where 
the  errors  are  uncorrelated  from  scene  to  scene,  we  are  roughly  talking  about 
a factor  or  square  root  of  two  for  a single  scene.  TYiat  translates  to  5.5 
microradian,  a little  more  than  an  arc  second,  four  meters  total  error  budget. 
All  errors  have  to  be  significantly  mailer  than  that.  At  30  meters  with  sub- 
pixel accuracy  specified  this  way  we  .iUve  an  extremely  challenging  job. 

Figure  2 describes  the  Landsat-D  processing  system.  The  characteristics  of 
the  Thematic  Mapper  and  the  Spacecraft  and  the  Tracking  Data  Relay  Satellite 
Systems  on  that  spacecraft  provide  essentially  all  constraints  of  spacecraft 
design.  Y m don't  have  much  flexibility  in  spacecraft  design.  We  first 
looked  at  the  Thematic  Mapper  as  a big  MSS  and  we  are  going  to  process  it  as 
an  MSS.  We  started  down  that  path  about  three  years  ago  doing  error  analysis 
and  every  time  we  would  examine  in  detail  some  of  the  errors  we  were  horri- 
fied. It  finally  got  to  the  point  were  we  were  about  3 pixels  temporal  regis- 
tration and  growing.  At  that  point  in  time,  we  went  to  the  Landsat-D  project 
and  said  something  has  to  be  done,  either  the  specs  have  to  be  changed  or  we 
have  to  redesign  the  processing  system,  from  a system  point  of  view.  That  was 
the  first  test  of  that  0.3  pixel,  and  it  would  have  been  much  easier  at  that 
point  in  time  to  say  0.3  pixel  was  not  really  required.  That  requirement  has, 
however  been  maintained.  What  I am  going  to  describe  now  is  an  overview  of 
the  changed  design,  which  essentially  we've  been  going  through  the  last  two 
years. 

In  our  attempt  to  meet  the  registration  goals,  we  had  to  get  involved  in  the 
workings  of  the  Thematic  Mapper.  We  had  to  get  in  there  and  really  understand 
how  that  worked  and  apply  our  processing  directly  to  the  inner  workings  of 
that  instrument.  We  could  not  hold  the  platfonn  steady  to  an  arc  second  or  a 
fraction  of  an  arc  second  to  achieve  a 1-arc-secor.d  total  error  budget.  The 
solution  there  was  to  measure.  We  installed  a small  angular  displacement  3- 
axis  package  on  the  Thematic  Mapper;  it  cannot  be  mounted  any  place  else  on 
the  spacecraft  because  of  structural  dynamic  effects.  It's  one  draw  back  is 
that  it  is  essentially  a high-pass  device,  and  the  electronics  we  build  for  it 
has  a band  of  2 Hz  to  125  Hz;  it  does  not  capture  the  low-frequency  end.  That 
shortcoming  was  alleviated  by  incorporating  some  of  the  hardware  that  was  al- 
ready on  the  spacecraft,  namely  the  attitude  control  drivers  wr.'.ch  have  a 
bandwidth  of  somewhere  just  above  0 Hz  to  2 Hz  nominally.  An  onboard  computer 
performs  functions  of  sampling  the  gyros  as  part  of  its  attitude  control  func- 
tion; it  estimates  the  gyro  drift,  gives  us  initial  attitude  estimates,  and  it 
is  the  source  of  an  ephemeris  if  tt-*  GPS  system  is  giving  the  ephemeris  to  the 
OBC,  which  then  sends  it  down  to  u.>,  and  sometimes  an  uplink  of  ephemeris  also 
comes  to  us  for  ground  processing  through  the  onboard  computer.  A formatter 
was  added,  which  is  essentially  a piece  of  hardware  that  takes  samples  of  the 
angular  displacement  sensor  and  sends  it  down  on  a telemetry  link  called  pay- 
load  correction  data.  That  data  set  is  all  the  information  external  to  the 
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Thematic  Mapper  needed  to  perform  Thematic  Mapper  Processing,  both  radiometric 
and  geometric. 

There  are  certain  pieces  of  additional  data  that  are  very  important.  We  know 
that  the  scan  mirror  is  not  perfectly  repeatable  in  the  Thematic  Mapper.  That 
was  determined  after  extensive  testing  by  Hughes  of  the  Thematic  Mapper  scan 
mirror  mecnanism.  In  order  to  characterize  the  scan  mirror  it  was  determined 
that  more  than  just  the  starting  and  end  locations  were  needed.  We  needed  an 
evaluation  point  in  the  middle  of  the  scan.  So  the  data  that  is  sent  down  is 
the  scan  start  time,  which  allows  us  to  coordinate  the  scan  mirror  positions 
with  all  the  other  measurement  systems  on  the  spacecraft*  The  scan  direction 
first-half  seccnti-half  scanner  essentially  tells  us  how  the  scan  profiles  are 
behaving  in  time.  In  the  ground  processing,  we  extract  the  scan  information 
out  of  the  wideband  data.  Payload  correction  processing  is  the  process  that 
takes  the  scan  mirror  information,  as  well  as  all  the  other  attitude  and 
ephemeris  related  information,  and  generates  systematic  correction  data  which 
will  essentially  remove  all  the  high-frequency  internal  distortions  when  ap- 
plied to  the  imagery.  At  that  point  of  time  we  have  not  captured  some  signi- 
ficant low-frequency  errors  relating  to  ephemeris  alignment,  time,  errors,  and 
low-frequency  attitude  errors.  Those  are  captured  by  ground  control  points 
(Figure  3)  used  to  adjust  the  data  and  to  derive  what  we  call  geodetic  correc- 
tion data,  which  is  an  identical  form,  but  improved  values  (see  Figure  4). 

In  the  meantime,  off-line,  there  is  a very  high  speed  reformating  and  radiome- 
tric correction  applied  to  the  imagery  in  parallel  to  generate  what  we  call 
archive  imagery.  Archive  imagery  is  available  as  a product  for  the  TM;  it 
includes  reformatted  imagery  with  the  data  appended  to  it.  The  next  step  in 
processing  is  to  actually  perform  the  resampling  based  on  this  product  for  the 
TM;  it  includes  reformatted  imagery  with  the  data  appended  to  it.  The  next 
step  in  processing  is  to  actually  perform  the  resampling  based  on  this  data. 
We  do  the  mapping  from  t:,e  input  space  to  the  map  coordinate  outboard  space. 

Figures  5 and  6 describe  the  error  budget.  In  review,  systematic  correction 
data  is  data  which  does  the  mapping  from  input  space  to  output  space,  but  con- 
trol points  have  not  been  included.  Control  points  remove  some  very  large 
errors,  but  they  are  low  frequency.  Ephemeris  uses  the  worst  case,  a 2-day 
predict  to  which  we  had  to  design.  This  time  is  the  result  of  the  + 20  milli- 
second clock  or  absolute  time.  Attitude  control  as  .01°  effective  meters,  1 
sigma,  is  an  alignment  which  is  a rather  large  nimber.  This  is  essentially  a 
fixed  bias,  and  I know  here  that  with  minimal  amounts  of  processing,  that  num- 
ber can  be  reduced  very  substantially  in  ground  processing  and  indeed  that 
will  ce  done.  But  immediately  after  launch,  we  could  have  alignment  errors 
that  large.  So  we  are  talking  about  rather  large  uncertainty  here,  so  there 
is  no  hope  of  knocking  all  of  these  down  to  anything  less  than  that  without 
using  ground  control  points.  The  ground  control  point  processing  is  substan- 
tially different  than  previous  processing  for  ground  control  points  in  its 
estimation  technique  in  that  it  is  a common  filter  smother-type  processing. 
We  have  developed  both  noise  models  and  dynamic  models  for  all  these  errors 
and  they  are  included  in  the  processing.  The  advantage  of  doing  that  is  that 
we  can  develop  the  processing  technique  that  is  significantly  less  sensitive 
tc  control  point  distribution.  One  of  the  major  problems  that  plagues  many  of 
tht  current  processing  systems  is  tha  f you  have  to  have  an  extremely  good 
distribution  cf  control  points,  you  better  not  have  any  control  points  that 
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are  in  serious  error  because  it  will  substantially  affect  polynomial  fits. 
With  this  technique  we  have  a very  graceful  degradation  in  performance  as  we 
change  the  locations  into  non-optimel  positions  and  we  can  propagate  through 
extended  periods  that  don't  have  control  points.  So  if  there  is  a group  of 
scenes  that  have  a number  of  control  points  at  the  top.  then  ten  scenes  later 
a n>r?ber  of  control  points,  we  are  not  necessarily  going  to  meet  our  accuracy 
requirements  in  between,  but  we  can  come  very  close  to  it,  as  we  can  verify 
performance  by  propagating  these  errors,  via  the  dynamic  models  of  the  filter 
smoother  estimation  technique. 
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Figure  1.-  Geometric  Accuracy  Specifications 


35 


ORIGINAL  PAG!  IS 
OF  POOR  QUALITY 


Figure  2.  Thematic  Mapper  Geometric  Correction 
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Figure  3.  Control  Point  Processing 
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igure  4.  Thematic  Mapper  System  Geometric  E 
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7.9  GEOMETRIC  VERIFICATION 


Gerald  0.  Grebowsky 
Goddard  Space  Flight  Center 


Before  proceeding  with  a discussion  of  geometric  verification  methods,  a 
brief  review  of  present  landsat  data  formats  will  clarify  how  both  geodetic 
location  and  registration  capabilities  were  defined.  Since  February  1979, 
Landsat  multispectral  scanner  (MSS)  data  has  been  processed  through  the 
master  data  processor  (MDP).  The  definition  of  the  fully  processed  output 
image  arrays  (P-tape  products)  was  intended  to  facilitate  both  geodetic 
location  and  temporal  registration  of  image  pixels.  The  world  reference 
system  (WRS)  nominal  image  centers  defined  in  degrees  and  integer  minutes  of 
latitude  and  longitude  were  selected  as  the  reference  points  in  output 
images.  Framing  of  MSS  images  was  defined  to  locate  the  WRS  nominal  image 
center  on  the  center  line  (line  1492)  of  the  output  array.  The  phasing  of 
the  geometric  resampling  process  was  defined  to  locate  the  WRS  center 
exactly  on  a pixel  (not  necessarily  the  center  pixel)  of  the  center  line. 
Finally,  at  the  WRS  pixel  the  orientation  of  the  center  line  relative  to 
rectangular  map  coordinates  was  specified  for  each  WRS. 

By  the  above  definitions,  the  geodetic  location  of  pixels  in  a P-tape  image 
lie  on  a 57  x 57  meter  grid  rotated  by  a specific  angle  (about  the  WRS  pixel 
identified  in  P-tape  header)  relative  to  the  rectangular  coordinates  of  the 
map  projection  used.  Two  images  for  a given  WRS  can  be  registered  by  simply 
shifting  one  of  the  arrays  in  the  along  scan  line  direction  to  account  for 
the  difference  in  pixel  locations  of  the  WRS  center. 

As  an  aside,  fully  processed  output  arrays  for  return  beam  vidicon  (RBV) 
data  were  defined  as  19  x 19  meter  grids  overlaying  the  MSS  grids  (3x3 
array  of  RBV  pixels  for  each  MSS  pixel ) . A pixel  and  1 ine  number  referencing 
each  RBV  subframe  relative  to  a WRS  pixel  are  given  in  the  header  of  an  RBV 
P-tape.  This  oefinition  of  RBV  arrays  was  intended  to  provide  a reg- 
istration capability  between  RBV  and  MSS. 

The  accuracy  of  a P-tape  image  is  a function  of  the  geometric  modeling  which 
determines  where  image  data  are  located  in  the  P-tape  array.  Since  there  is 
only  one  geometric  model  used  in  the  MDP,  geometric  location  accuracy 
depends  on  the  absolute  accuracy  of  the  model  and  registration  accuracy  is 
determined  by  the  stability  of  the  model.  Due  primarily  to  inaccuracies  in 
data  provided  by  the  Landsat  attitude  measurement  system  (AMS),  desired 
accuracies  are  attainable  only  by  using  ground  control  points  (GCP)  and  a 
correlation  process. 
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Control  points  consist  of  32  x 32  arrays  of  MSS  data  with  locations  defined 
by  latitude  and  longitude.  When  maps  are  available,  the  locations  are 
derived  from  the  maps  and  both  location  and  registration  accuracy  will  oe 
improved.  Without  maps,  locations  are  derived  from  a reference  P-tape  image 
using  the  array  location  definition  previously  discussed.  In  these  cases 
only  the  stability  of  the  geometry  and,  therefore,  the  registration 
accuracy  is  improved. 

The  performance  specifications  for  MSS  P-tape  data  were  .5  pixel  (per  axis) 
geodetic  location  and  .3  pixel  (per  axis)  registration.  In  the  development 
of  the  MDP,  this  specification  was  taken  with  reference  to  input  pixel 
instantaneous  field  of  view  ( I FOV ) of  approximately  80  meters.  In  terms  of 
the  57  meter  pixel  spacing  of  output  P-tape  arrays,  these  specifications 
convert  to  .7  pixel  (per  axis)  geodetic  location  and  .4  pixel  (per  axis) 
registration.  This  performance  requires  successful  correlation  of  20-25 
well  distributed  control  points  in  an  MSS  image.  The  geodetic  location 
specification  also  requires  the  control  points  to  have  location  errors  less 
than  35  meters  (rms)  relative  to  refence  maps. 

The  verification  of  system  performance  with  regard  to  geodetic  location 
requires  the  capability  to  determine  pixel  positions  of  map  points  iri  a P- 
tape  array.  Verification  of  registration  performance  requires  the  capa- 
bility to  determine  pixel  positions  of  common  points  (not  necessarily  map 
points)  in  2 or  more  P-tape  arrays  for  a given  WRS  scene.  It  should  be  noted 
that  registration  measurements  will  identify  changes  in  location,  while  the 
difference  between  location  measurements  yields  the  registration  error. 
Thus  an  accurate  geodetic  location  verification  provides  registration  data 
and  registration  verification  can  provide  location  data  if  one  of  the  P- 
tapes  has  been  verified  geodetical ly.  This  relationship  offers  the 
opportunity  for  alternate  (or  mutually  checking)  implementations  for 
verification  of  geometry. 

Since  the  building  of  a GCP  library  for  the  MDP  consisted  of  accurately 
identifying  the  locations  of  32  x 32  MSS  arrays  relative  to  maps,  the 
library  build  function  demonstrated  a method  for  location  verification. 
The  location  funtion  was  accomplished  by  a manual  overlay  of  a map  feature 
and  a cathode  ray  tube  (CRT)  display  of  MSS  data.  The  overlay  was 
accomplished  using  a Bausch  and  Lomb  zoom-transfer  scope  which  provides  an 
optical  superposition  of  2 inputs  through  a binocular  viewer.  The  inputs 
were  a CRT  display  of  MSS  data  (scaled  according  to  available  map  scale)  and 
the  actual  map  with  a feature  identified.  The  manual  overlay  of  the 
superimposed  binocular  view  consisted  of  simply  moving  the  map  to  give  the 
best  fit  to  the  displayed  MSS  data.  The  specific  point  on  the  map  for  which 
latitude  and  longitude  had  been  defined  was  then  identified  by  moving  a 
cursor  on  the  CRT  display.  The  cursor  position  identified  the  center  of  the 
32  x 32  GCP  array  to  be  stored  in  the  MDP  library  and  the  fractional  pixel 
location  of  the  defined  latitude  and  longitude  within  the  32  x 32  array. 
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Using  this  technique  f r geodetic  location  verification  is  straightforward. 
For  a selected  map  feature,  the  expected  pixel  and  line  number  location  in 
a P^tape  image  can  be  calculated  from  the  latitude  and  longitude  using  the 
appropriate  map  transformation  and  rotation  of  coordinates  previously 
described.  This  calculated  location  identifies  the  area  of  MSS  data  to  be 
displayed  on  the  CRT.  The  cursor  position  after  manual  superposition 
identifies  the  measured  pixel  and  line  number  location  of  the  map  feature. 
The  location  error  is  simply  the  difference  between  the  expected  and 
measured  locations. 

An  improved  version  of  this  technique  can  be  developed  by  converting  the 
selected  area  of  a map  to  a digital  video  signal  and  combining  the  map  and 
MSS  displays  directly  onto  the  CRT  display.  A short  study  by  IBM 
demonstrated  that  this  superimposed  display  facilitates  the  manual  overlay 
function. 

Techniques  for  registration  verification  can  be  more  varied  and  automated 
since  map  data  are  not  required.  Although  correlation  of  common  features 
would  be  possible,  edge  detection  and  correlation  of  arbitrary  areas  is 
probably  preferable.  Goddard's  Large  Area  Crop  Inventory  Experiment 
(LACIE)  processor  used  edge  detection  and  matching  to  extract  sample 
segments  (117  lines,  160  pixels)  registered  to  a reference  segment.  This 
system  met  its  specified  registration  goal  of  1 pixel  (rms).  However,  ail 
LACIE  extractions  were  verified  by  manually  comparing  film  images  of  the 
extracted  segments  with  the  reference  segment  and  a small  percentage  were 
rejected  due  to  registration  errors.  This  experience  demonstrated  the  need 
for  a manual  backup  test.  Rather  than  using  film  images,  a CRT  display  with 
the  capability  to  flicker  between  2 test  areas  is  recommended  for 
verification  testing.  This  manual  mode  would  not  have  a strict  accuracy 
requirement  since  it  would  only  be  used  to  assure  that  a correlation  should 
exist. 

One  additional  lesson  can  be  learned  from  the  LACIE  System.  During  the 
development  effort,  experiments  showed  that  edge  data  of  a single  MSS  band 
were  not  necessarily  invariant  with  seasonal  changes.  In  fact,  edges 
appearing  in  one  band  for  one  season  occasionally  appeared  in  another  band 
for  another  season.  This  effect  lead  to  the  use  of  composite  edge  images 
using  MSS  bands  5 and  7.  Similar  considerations  may  be  required  in  a 
registration  verification  system. 

Although  automated  verification  methods  are  hignly  desirable,  manual 
processes  are  presently  necessary  when  dealing  with  maps  and  advisable  for 
verifying  registration  correlations.  Manual  processes  offer  an  additional 
verification  capability  in  terms  of  exposing  higher  frequency  distortions 
in  image  data.  Automated  correlation  functions  produce  mean  results  for  the 
areas  correlated  and  may  be  insensitive  to  registration  errors  in  smaller 
areas. 
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Tne  implementation  of  a verification  system  will  depend  on  the  number  of 
measurements  required  per  image  and  the  number  of  images  to  be  verified.  In 
turn,  these  requirements  depend  on  user  expectations  implied  by  performance 
specifications.  The  final  question  is:  which  of  the  following  verification 
levels  are  required  by  data  users? 

a)  100  percent  of  pixels  in  an  image  within  specificates 

b}  Less  than  100  percent,  but  some  minimum  percent  of  pixels  in  an 

image  within  specifications 

c)  A probability  that  an  image  meets  specif ication 
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8.0  SYSTEMS  PRESENTATIONS  AND  DISCUSSION  PAPERS 


8.1  SUMMARY 

In  response  to  the  workshop  call  for  additional  papers  that  represent  recent 
thinking  on  the  problem  of  registration  and  rectification,  ten  papers  were 
received.  Three  were  concerned  with  the  impact  of  misregistration  upon  the 
overall  information  content  (i.e.,  utility)  of  data  being  used  for  models 
based  on  multitemporal  analysis,  particularly  for  croptyping.  Five  papers 
were  concerned  with  the  problem  of  accurately  determining  spacecraft  attitude 
in  near-earth  orbits  and  the  resultant  impact  on  precise  registration  rnd  rec- 
tification of  terrestrial  imagery.  Two  papers  proposed  spaceborne  imagery 
systems  that  would  serve  multiple  roles  by  incorporating  multiple  resolutions 
and  view  angles,  each  imaging  component  being  optimized  for  a different  func- 
tion. This  contrasts  with  the  current  approach  toward  a single  genc-al  pur- 
pose sensor.  Four  papers  proposed  ways  to  improve  attitude  control,  either 
through  improved  engineering  of  future  spacecraft  and  ephemeris  instrumenta- 
tion, or  through  enhanced  techniques  for  ground  segment  processing  of  control 
points. 
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8.2  MISREGISTRATION'S  EFFECTS  ON  CLASSIFICATION  *D  PROPORTION  ESTIMATION 

-r  ACCURACY*  o' 

>N 

Ri  Juday  and  F.  Hall,  Johnson  Space  Center 


The  estimates  of  crop  type  and  acreage  (proportion  estimation)  are  undertaken 
in  the  AgRISTARS  program  by  registering  multiple  date  acquisitions  of  small 
subareas  of  Landsat  scenes  (termed  segments),  and  applying  mul tispectral  anal- 
ysis to  them.  An  important  contribution  to  errors  in  classification  and  acre- 
age estimates  is  misregistration  between  multiple  acquisitions.  The  relation- 
ship can  be  expressed  as: 

VAR  (A)  = I a). o.2 

i i 1 

= VARIANCE  OF  ACREAGE  ESTIMATE  FOR  iTE  STRATUM 


= WEIGHT  WHICH  DEPENDS  ON  STRATUM  SIZE 


a . 


‘“i)2  ? “A2  * V2 ' A cov(-;oV 


o . 


= VARIANCE  RESULTING  FROM  SAMPLING 


a . 


= VARIANCE  RESULTING  FROM  SAMPLE  SEGMENT  PROPORTION  ESTIMATES 


= PROPORTION  ESTIMATE  IN  iTH  SEGMENT 


The  particular  series  of  operations  applied  are  shown  diagrammatical ly  in 
Figure  1.  The  spectral  data  brought  in  with  ancillary  data  are  transformed 
into  the  Kauth-Thomas  space,  where  features  are  extracted.  The  Kauth-Thomas 
greeness  is  ?.  function  of  time  for  multiple  acquisitions.  It  is  approximated 
in  functional  form  with  various  parameters  and  the  vector  of  these  parameters 
and  its  distribution  within  the  segment  you  are  working  with  is  decomposed  so 
that  its  overall  distribution  function  is  approximated  a posteriori . The  a 
priori  probabilities  given  class  and  spectral  vector  that  describe  a class  are 
the  parameters  that  give  you  the  estimate  of  the  area  and  crop  type.  The  an- 
cillary data  is  the  place  where  you  bring  in  the  fact  that  you  are  working  in 
a specific  area,  thereby  limiting  the  variety  of  possible  crop  choices. 


Figure  2 illustrates  the  taking  of  a Landsat  feature  vector  and  deriving  the 
brightness  and  the  greeness.  A procedure  derives  certain  pa-ameters  that  de- 
scribe the  time  at  which  a crop  begins  to  green  up,  and  the  steepness  with 
respect  to  which  the  curve  moves  off  the  soil  line  is  a function  of  time;  time 

being  a characteristic  difference  between  some  of  the  crops  that  we're  trying 
to  differentiate.  This  kind  of  procedure  is  sensitive  to  absolute  radiometry 
to  perhaps  a larger  extent  than  some  researcners  maybe  are  interested  in  with 
regard  to  maintaining  radiometric  fidelity  in  the  resampling  process.  Figure 
3 illustrates  the  procedure  whereby  a scene  is  broken  into  various  strata. 
There  are  distribution  functions  within  each  strata  for  the  spectral  measure- 
ment vectors  via  a procedure  called  CLASSY.  CLASSY  breaks  the  curve  down  to 
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several  distributions  which  are  assumed  unimodal  and  normal.  This  is  the 
place  at  which  the  proportion  estimates  fall  out.  In  the  process  of  doing 
this,  the  mixture  pixels  along  the  boundaries  of  the  segments  create  confu- 
sion. Registration  error  looks  something  like  a mixture  pixel.  If  there  is 
misregistration,  and  a given  address  for  a pixel  jumps  across  the  boundary,  it 
acts  as  a noise,  and  in  the  oultitemporal  sense  will  tend  to  confuse  crop  dis- 
crimination. 

Figure  M presents  the  expression  of  pure  and  mixed  pixel  contributions  to 
classification  error.  Knowing  full  well  that  we  have  mixture  pixels,  and  if 
you  can  parameterize  the  problem  in  terms  of  your  estimate  of  a crop  that  has 
found  its  truer  pixels,  the  equation  can  be  applied  to  derive  a final  propor- 
tion estimate.  The  variance  in  the  estimate  of  the  crop  proportion  in  mixed 
pixels  is  typically  larger  than  the  variance  of  the  estimate  of  the  crop  that 
is  in  pure  pixels.  You  would  like  to  have  q,  which  is  the  proportion  of  the 
scene  which  is  in  pure  pixels,  to  be  a larger  number  so  as  to  reduce  the  over- 
all variance.  That,  of  course,  is  done  in  one  way  by  going  to  smaller  pixels 
and  in  another  by  having  better  registration  accuracy  so  that  you  don't  have 
the  multitemporal  jumping  of  pixels.  Now  the  quantity  q will  approach  a num- 
ber that  is  limited  by  the  spatial  resolution  of  the  system  as  the  registra- 
tion error  declines.  There  is  a point  at  which  you  cannot  drive  q to  be  a 
larger  number  with  increasing  registration  accuracy  and  that  declining  gain 
determines  the  point  at  which  for  any  particular  analysis  technique,  it  is  not 
practical  to  expend  more  effort  in  trying  to  get  better. 

For  any  given  sensor  IFOV  geometry,  you  can  derive  ty  al  populations  of 
fields  and  you  can  plot  histograms  of  the  number  of  fielc  against  field  size 
and  you  can  draw  different  histograms  for  the  different  k nds  of  crops  that, 
according  to  your  ground  truth,  go  into  making  up  the  population  examined. 
Dave  Pitts  and  Gothem  Bad h war  have  published  some  results  for  representative 
samples  in  the  growing  regions  of  the  U.S.  that  are  of  significance  to  us 
(Figure  5).  As  a function  of  the  resolution  element,  the  IFOV  of  the  sensor, 
according  to  those  kinds  of  histograms  in  Figure  5,  can  draw  the  proportion  of 
pure  pixels  in  a given  crop  (Figure  6).  This  is  the  quantity  which  you  would 
like  tc  drive  up.  The  TM  will  have  a resolution  that  is  considerably  smaller, 
so  the  proportion  of  pixels  that  are  pure  in  any  given  area  will  be  larger. 
You  can  draw  an  analogy  between  the  misregistration  error  as  acting  much  the 
same  as  an  increased  resolution  IFOV  and  expect  that  things  will  go  in  the 
same  direction  although  we  have  some  doubts  that  you  can  draw  an  exact  equi- 
valence there  because  there  is  some  difference  in  behavior. 

This  is  a workshop  and  not  a symposium  so  I am  not  presenting  a final  result. 
At  this  point  we  do  have  a program  underway  to  come  up  with  quantitative  num- 
bers for  the  results  for  the  effect  of  the  misregistration  error.  Also,  we 
are  tending  to  work  mostly  on  the  multitemporal  aspects  of  misregistration  at 
this  point.  Band-to-band  misregistration  has  similar  effect,  but,  in  our  par- 
ticular application,  it's  a less  dynamic  kind  of  an  affect.  We  built  a regis- 
tration system  at-  JSC  to  a point  when  it  was  clear  that  the  one  pixel  regis- 
tration accuracy  that  the  LACIE  processor  was  giving  us  was  only  marginally 
adequate  for  the  LACIE  technology,  and  with  AgRISTARS  we  needed  something 
better.  The  MDP,  being  a full-frame  system,  does  not  concentrate  as  heavily 
its  computation  power  on  an  individual  pixel.  We  set  ou  selves  a goal  of  2/10 
pixels  as  the  registration  accuracy  that  we  would  like  to  get  to.  This  was 
based  on  the  arbitrary  criteria  that  what  you  would  like  is  50X  of  the  multi- 
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temporal  energy  to  come  from  a common  area  on  the  ground.  When  you  do  that, 
it’s  really  amazing  how  strictly  that  ties  down  the  registration  accuracy  that 
you  think  you  would  like  to  get  to.  When  you  begin  talking  about  registration 
at  that  accuracy  you  uncover  all  sorts  of  things  that  you  didn’t  have  to  think 
about  previously.  As  Figure  7 illustrates,  the  difficult  problem  to  determine 
is  the  registration  accuracy  that  you  want  analytically  when  you  overlay  one 
aperture  over  another.  For  pixel  A and  pixel  B.  the  portion  of  the  clear 
aperture  is  a function  of  the  position  of  the  pixel  B,  given  pixel  A is  fairly 
easy  to  calculate.  But  when  you  begin  to  add  other  pixels  that  complicate? 
your  clear  aperture  upon  adding  a third  aperture,  given  a position  of  the 
first  two  is  some  value  on  the  ramp.  It  is  highly  nonlinear  and  this  gets 
worse  when  you  go  to  two  dimensions,  and  when  you  get  nonsquare  IFOVs,  and 
when  you  have  a variation  of  response  within  a IFOV.  Our  plan  is  to  pursue  a 
Monte  Carlo  approach  in  assuming  a misregistration  error  and  model  its  distri- 
bution through  the  process. 

In  conclusion,  it  should  be  noted  that  we  do  not  have  a quantification  of  mis- 
registration’s effect  on  our  analysis  at  levels  better  than  we  currently 
achieve.  Synthetic  data  is  one  approach;  extrapolations  obtained  by  deregis- 
tration is  another.  Registration  accuracy  requirements  are  difficult  to  spe- 
cify  a priori . "More  is  better”;  everyone’s  on  expert.  ExtraDolation  to  the 
performance  expected  from  better  registration  is  risky,  and  highly  dependent 
on  analysis  techniques.  The  proper  arena  for  testing  is  one’s  own  applica- 
tions analysis. 
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Figure  1 . Crop  ID/Proportion  Est. 


LINEAR  TRANSFORMATION  PROFILE  PARAMETERIZATION 

Figure  2.  Data  Transformation/Feature  Extraction 
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DIGITAL  IMAGE  SCENE 
Figure  3.  Mixture  Decomposition  Estimation 


397 


ORIGINAL  PAQfc  >'■ 
CF  POOR  QUALlti 


P ■ QP0  + (l-q)Pn 

P = PROPORTION  ESTIMATE  FOR  SCENE  FOR  CROP 
P0  = ESTIMATE  OF  CROP  PROPORTION  IN  PURE  PIXEL  AREA 
Pm  = ESTIMATE  OF  CROP  PROPORTION  IN  MIXED  PIXEL  AREA 
q = PROPORTION  CF  SCENE  IN  PURE  PIXELS 

VAR  P = q2n0+  (l-q)2om2  + 2q(l-q)o0m 

a02  = VAR  (P0) 

°m2  = VAR  (Pm) 

°om  = COV  (PoPm) 

Figure  4.  Pure  and  Mixed  Pixel  Error  Contributions 
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FICUllK  C Field  size  distribution  fur  winter  wheat,  com,  soybeans, 
tpnng  wheat,  winter  wheat  including  strip  fallow,  and  spring  wncat 
Including  strip  fallow. 
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8.3  data  VS.  INFORMATION:  A SYSTEM  PARADIGM 

Fred  C.  Billingsley 

Jet  Propulsion  Laboratory,  California  Institute  of  Technology 
Pasadena,  California  911 0^ 

This  is  a paper  about  thinking. 

It  may  not  seem  to  be,  but  it  is. 

As  such,  it  won't  give  any  answers. 

But  it  should  give  you  some  ideas. 

In  the  justification  stage  of  any  new  system,  the  proponent  is  usually  asked 
to  provide  some  sort  of  Benefit/Cost  analysis.  Because,  for  a data  system, 
there  is  no  value  in  the  data  per  se,  justification  must  be  found  in  the 
benefits  in  the  vse  of  the  data.  If,  as  is  usually  the  case,  the  instrument 
or  system  designer  is  not  a "user",  his  recourse  is  to  survey  the  user 
community  to  obtain  some  sort  of  consensus  on  the  utility.  The  generally 
unsatisfactory  nature  of  the  resuls  is  reflected  in  the  large  number  of  times 
the  users  are  surveyed,  resurveyed,  and  re-r esurvey ed.  Something  must  be 
missing,  or  the  answers  would  have  been  found. 

The  thrust  here  is  not  the  justification  of  the  system  itself,  but  rather  the 
justification  of  the  selection  of  the  various  technical  parameters  which  the 
system  must  meet.  This  justification  (i.e.,  optimum  parameter  tradeoff)  must 
be  done  in  relation  to  the  ability  of  the  user  to  turn  the  cold,  impersonal 
data  into  a live,  personal  decision  or  piece  of  information. 

Therein,  of  course,  lies  the  sleeper:  the  data  system  designer  requires  data 

parameters,  and  is  dependent  on  the  user  to  convert  his  information  needs  to 
these  data  parameters.  This  conversion  will  be  done  with  more  or  less 
accuracy,  beginning  a chain  of  inaccuracies  which  propogate  through  the 
system,  and  which,  in  the  end,  may  prevent  the  user  from  converting  the  data 
which  he  receives  into  the  information  he  requires.  The  concept  to  be  pursued 
will  be  that  errors  will  o^vr  in  various  parts  of  the  system,  and,  having 
occurred,  will  prorogate  tu  the  end.  Modeling  of  the  system  may  allow  an 
estimation  of  the  effects  at  any  point  and  the  final  accumulated  effect,  and 
may  provide  a method  of  allocating  an  error  budget  among  the  system  components. 

Inaccuracies  will  be  considered  to  be  of  two  types,  which  may  be  stated  in 
terms  of  transfer  functions  for  each  of  the  system  components  considered:  1) 

Calibration — the  difference  between  the  stated  transfer  function  and  reality; 
2)  Uncertainty — the  error  bars  around  each  stated  function  and  measurement. 


This  paper  presents  the  results  of  one  phase  of  research  performed  by  the  Jet 
Propulsion  Laboratory,  California  Institute  of  Technology,  sponsored  by  the 
National  Aeronautics  and  Space  Administration  under  Contract  f*AS7-100. 
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We  begin  by  modeling  an  information  system  as  shown  in  Figure  1.  The  forward 
model  is  required  to  convert  units  of  information  to  units  of  required  data, 
and  answers  the  question  "What  set  of  measurements  will  best  cai  :y  (i.e., 
allow  the  best  derivation  of)  the  information?"  This  box  provides  the  set  of 
measurement  "requirements"  to  the  measuring  system,  which  responds  with  a s^t 
of  real  measurements  which  will  hopefully  be  somewhat  near  to  the  desired  set. 
However,  the  data  system  may  have  an  inaccurate  or  uncertain  transfer 
function,  so  that  the  set  of  apparent  measurements  presented  to  the 
information  model  deviate  further  from  reality.  It  is  with  this  set  that  the 
user  attempts  to  derive  his  information,  using  the  Information  Model. 

Evaluation  of  the  system  takes  place  in  two  levels  as  suggested  in  Figure  2. 
Note  that  the  evaluation  (and,  therefore,  the  design)  of  a total  information 
system  is  the  joint  responsibility  of  the  user  and  the  data  system  designer, 
as  model  boxes  under  the  cognizance  of  each  are  involved.  The  data  system 
designer  cannot  be  held  for  the  inadequacies/uncertainties  in  either  the 
forward  or  the  information  models,  although  he  is  deeply  interested  in  the 
validity  of  each. 

Care  must  be  taken  in  designing  the  models,  and  the  systems  which  they 
represent.  Figure  3 applies  to  both  models  and  systems.  At  the  low  end  of 
complexity,  the  system  may  only  provide  a nominal  solution  to  the  information 
problem  (a),  and  so  the  potential  errors  due  to  the  design  may  be  quite  large. 
But  at  least,  the  data  can  be  obtained.  At  the  other  extreme,  c complex 

model(D)  can  produce  the  desired  results  quite  precisely,  if  only  the  data 
required  for  the^solution  could  be  obtained  (c l).  If  it  can  be  identified,  the 
saddle  point,  (e),  is  the  optimum  complexity  to  design  to.  In  the  case  of 
registration  of  Landcat,  for  example,  the  saddle  point  may  be  found  to  be  at 
the  0.5-1. 5 pixel  level,  fairly  broad,  with  the  moderate  gains  obtained  with 
very  complex  processing  being  very  costly  or  the  requisite  complex  data  (e.g., 
world-wide  GCPs)  being  unobtainable,  or  at  the  low  complexity  end,  simple 
processing  producing  only  moderate  registration  accuracy. 

SYSTEM  DESIv>.i 

We  will  be  concerned  primarily  with  the  data  system  design.  This  includes  the 
choice  of  the  parameters  (e.g.,  spectral  bands,  resolution,  etc.),  the 
exactness  with  which  they  must  be  maintained,  the  calibration  process 
including  the  availabilty  of  required  ancillary  data,  data  latency,  and  the 
uncertainties  associated  with  each  of  these  items.  This  must  be  done  in  the 
context  of  the  complete  information  system.  The  data  system  block  is 
diagrammed  in  Figure  4. 

Two  approaches  may  be  taken  to  the  data  system  design:  1)  Optimize  the  data 

system  by  minimizing  the  summation  of  the  deviations  of  the  delivered  products 
from  the  desired  measurements;  2)  Optimize  the  total  information  system  by 
minimizing  the  decreases  in  obtainable  information  (by  the  users)  due  to 
deviations  in  the  desired  measurements  from  the  requested  set.  One  of  these 
approaches  is  used  implicitly,  if  not  explicitly,  in  any  system  design.  They 
do  not  necessarily  lead  to  the  same  choice  of  parameters. 


402 


ORIGINAL  PAGE.  IS 
OF  POOR  QUALITY 


T;us,  the  data  system  design  model  for  1)  is  diagrammed  Figure  5.  Tt  can 
be  seen  that  this  is  a linear  programming  problem.  The  loss  function  to  be 
minimized  is  the  (weighted,  according  to  the  importance  of  the  various 
disciplines)  sum  of  the  deviations  in  the  data  delivered  from  each  discipline 
request.  The  parameters  available  to  the  designer  are  the  sensor  bogie 
parameters,  anticipated  interference  factors  (such  as  sensor  v oraaous, 
ground  altitude  relief  displacements,  orbit  uncertainties,  etc.),  the  ability 
to  measure  these,  the  calibration  forward  model  (i.e.,  how  do  we  plan  to 
remove  the  errors?),  data  system  procedures,  availability/accu  acy  of 
calibration  references,  and  the  procedures  used  to  rectify  (apply  the 
calibrations).  To  properly  choose  between  the  parameters,  coefficients 
pertaining  to  the  sensitivity  of  results  to  variations  in  each  parameter  and 
to  the  importance  of  the  various  parameters  are  required.  (For  example,  how 
important  to  Discipline  A is  the  difference  between  prompt  registration  to  1 
pixel  vs.  delayed  registration  to  0.3  pixel;  how  important  are  these  relative 
to  overlay  matching  or  to  absolute  geodetic  location,  and  how  imoortant  is 
Discipline  A in  the  total  scheme  of  things?)  These  coefficients,  if  available 
at  all,  will  gen  rally  be  only  poorly  known.  Note,  however,  that  i i they  are 
not  explicitly  stated,  they  will  be  assumed  by  the  data  system  designer  with 
or  without  affirmation  by  the  discipline  users.  A caveat  to  the  users! 

In  approach  2),  the  user  and  his  forward  and  information  models  are  explicitly 
treated,  as  demonstrated  in  Figure  6.  In  this  case,  *he  information  system 
design  must  take  into  account  the  effect  of  the  real  data  on  the  information 
conversion  in  the  information  models,  recognizing  that  it  will  be  different 
from  the  desired  data  and  will  be  accompanied  by  the  accutaulated 
uncertainties.  In  addition  to  the  set  of  data  system  parameters,  available 
also  are  potential  changes  in  the  forward  and  information  models  (e.g.,  the 
user  may  have  to  do  things  differently  than  first  planned  if  the  anticipated 
real  data  is  too  divergent  from  the  data  desired  or  if  it  will  be  accompanied 
by  too  large  errors.)  In  an  informaton-driven  system,  the  information  losses 
allowed  will  place  tolerances  on  the  real  data.  This  requires  that  the 
information  model  be  accompanied  with  a ensitivity  analysis.  The 
inf ormation/ forward  model  linear  programming  optimization  v i 1 1 -llow  the  user 
to  trade  off  the  various  desired  parameters  requested,  allowing  for  the 
anticipation  of  data  realities  and  the  influences  of  the  other  disciplines  o a 
the  total  information  system  outcome. 

Again,  a caveat  to  the  users — this  procedure,  usually  implicit,  require*  the 
choosing  of  sensitivity  coef f icients,  also  usually  implicit.  The  user  with 
particularly  sensitive  requirements  hud  best  make  his  needs  known! 

Just  as  the  various  errors  propagate  to  the  end  ("downstream"),  in  an 
information-driven  system  the  tolerances  will  propagate  upstream.  The 
implication  is  that,  in  contrast  to  the  normal  single- thread  system  which 
requires  ever-tighter  tolerances  in  the  earlier  stages,  it  may  be  possible  for 
certain  users  to  pick  off  data  earlier  in  the  data  slrt^ui  before  errors  have 
had  a chance  to  accumulate,  aud  tor  them  to  do  their  own  processing.  This  may 
relieve  error  tolerances  on  che  remainder  of  the  system. 
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In  addition  to  the  sensitivity  coefficients  for  a single  parameter,  cross 
coefficients  may  be  important  in  analyzing  the  tradeoffs.  Four  examples  of 
interdependency  of  variables  are  sketched  in  Figure  7.  For  example,  with 
Variable  A being  spatial  resolution  and  Variable  B being  data  rate:  Case  I 

(upper  left),  a user  may  have  lots  of  computer  capability,  so  that  data 
quantity  is  no  problem,  but  increasing  resolution  improves  things  up  to  a 
point  after  which  (say)  scatter  in  the  data  decreases  his  performance.  In 
Case  IV  (lower  right)  a smaller  user  finds  the  same  type  of  resolution 
optimization,  but  total  data  quantity  hurts,  so  that  at  some  point  the 
increase  of  data  with  resolution  becomes  the  limiting  factor. 

As  a second  example,  let  the  variables  be  ability  to  register  (in  pixels)  vs. 
the  pixel  size,  and  let  us  consider  three  cases:  1)  user  doesn't  care  about 

registration  at  all,  because  he  is  only  looking  at  a single  image;  2)  desired 
geodetic  location  (in,  say,  met-  rs)  is  constant  regardless  of  resolution 
because  the  user  must  register  to  GCP  at  the  same  location  accuracy 
independent  of  resolution;  this  user  requires  that  the  per  pixel  registration 
get  better  as  the  pixels  get  larger;  3)  for  overlay  purposes,  the  same 
fractional  pixel  accuracy  is  required  regardless  of  the  pixel  size.  These  are 
sketched  in  Figure  8,  together  with  a hypothetical  system  peformance.  The 
heavy  line  in  Figure  8 indicates  the  ridge  of  optimum  performance  from  the 
user  point  of  view.  The  intersection  of  the  anticipated  system  performance 
with  the  user  ridge  indicates  the  design  optimum. 

It  is  realized  that  the  bogie  parameters,  sensitivity  coefficients,  and  cross- 
sensitivity coefficients  required  to  do  a quantitative  system  optimization 
will  generally  not  be  available.  Nevertheless,  these  are  implicitly  defined 
in  the  system  designer's  mind.  He  will  make  a mental  evaluation  of  the  user 
forward  sad  information  models,  and  try  to  decide  which  parameters  are 
important  and  which  can  be  slighted,  and  then  proceed  to  the  data  system 
design.  Much  fundamental  research  remains  to  be  done  to  define  the  forward 
and  information  user  models  and  to  obtain  the  sensitivity  factors,  to  allow 
these  to  be  used  in  a quantitative  total  information  system  design. 

SYSTEM  ANALYSIS 

Somehow  the  system  design  is  arrived  at,  the  sensor  built  and  data  delivered. 
The  user  must  then  work  with  whatever  data  is  now  available,  together  with  its 
errors.  At  that  point  he  has  only  the  information  model  to  vary — that  is,  he 
will  do  whatever  necessary  to  derive  the  desired  information.  We  will  leave 
bin  t ^ nis  troubles,  and  consider  the  data  system  itself.  The  task  at  this 
point  is  to  evaluate  the  system  performance  (see  Figure  9). 

The  normal  desire  in  designing  a system  is  that  each  function  be  a 1:1 
translation,  with  a change  in  dimensions  only,  until  finally  the  "correct 
measurement"  is  the  same  as  the  "desired  measurement".  We  will  therefore 
model  each  function  ac  "somewhat  linear,  with  a bias"  (figure  left),  but  let 
the  output  be  produced  with  some  uncertainty  (figure  right).  For  a linear 
system  with  th°  input  having  any  possible  value  with  equal  probabilty,  the 
probability  that  the  output  has  a value  in  a certain  range  is  found  by 
convolving  the  probability  density  function  of  the  error  with  that  of  the 
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Transfer 

Without 

Error 

Propagation 


Transfer 

With 

Error 

Propagation 


signal,  and  integrating  between  limits  representing  the  range  of  interest. 
(Note  that  the  probability  distribution  function  of  the  error  is  equivalent, 
in  one  dimension,  to  the  point  spread  function  of  the  image  case.  The  symbol 
h will  therefore  be  used.)  Define  the  "gain"  of  each  stage  as  Output/Input  * 
a,  so  that  for  a two  stage  system. 


y2  = 


alyl*hl 


y3  = 


a2y2*h2  = (aiyl*hl}  a?*h- 


For  constant  total  system  gain  minimum  error  occurs  when  aj  » a?.  This 

leads  to  the  engineers'  old  rule  of  thumb:  put  as  much  gain  aheaa  of  any 

noise  sources  as  possible* 

If  the  error  sources  are  Gaussian,  the  convolutions  become  root-mean-square 
additions.  However,  in  the  registration  case,  it  is  not  yet  clear  whether  the 
error  sources  are  Gaussian,  so  the  RMS  addition  must  be  used  wih  caution.  It 
is  also  not  clear  whether  an  RMS  statement  of  the  errors  is  the  one  most 
useful  to  the  user  in  evaluating  the  system  performance.  For  example,  it  may 
be  more  important  for  the  user  to  know  where  the  displacement  errors  occur 
(worse  in  areas  of  high  relief  and  predictable  in  direction)  than  it  is  for 
him  to  know  an  RMS  value  (which  in  itself  may  be  suspect). 

It  should  be  noted  that  a statement  of  the  errors  occurring  in  various  parts 
of  the  system  is  of  marginal  use  by  itself  unless,  perhaps,  one  or  more  is 
glaringly  bad.  Not  until  the  system  model  is  built  (implicitly  or  explicitly) 
can  the  error  propagation  be  estimated.  During  system  design,  the  propagation 
estimate  is  used  to  establish  tolerances  on  the  components,  and  during  evaluat 
it  will  be  used  with  the  actual  expected  errors  to  check  performance  and  to 
identify  critical  error  contributors.  After  the  contributing  error  sources 
and  their  interactions  are  identified,  the  following  questions  may  be  asked  of 
each  source  and  of  the  system  as  a whole: 

* What  is  the  intended  component  performance? 

* What  is  the  component  actual  expected  performance? 

* How  may  the  performance  be  verified? 

* What  correction  methods  are  available  for  system  us^? 

* What  correction  methods  are  available  for  user  use? 

* How  well  can  the  correction  methods  potentially  work? 

* How  well  may  the  correction  methods  actually  work? 
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How  do  inaccuracies  propagate  through  the  system? 

How  do  uncertainties  propagate  through  the  system? 
Where  are  the  major  inaccuracy  or  uncertainty  sources? 


Finally,  it  is  to  be  expected  that  there  may  be  breakdowns  during  operation, 
or  that  there  may  be  operational  problems  in  performing  the  component 
functions*  Considering  probability  of  correct  operation  as  a system 
criterion,  the  following  questions  are  pertinent: 

* What  slack  is  there  in  the  design  to  allow  for  problems? 

* If  a problem  occurs,  will  the  system  fail  catastrophically  or 

graceful ly? 

* What  is  the  probability  that  the  system  will  remain  up  (within  specs) 
for  XX  of  the  time  ? 

* How  hard  does  the  system, seem  to  be  to  operate? 

* What  potential  for  operator  errors  are  present? 

* Are  work-arounds  for  various  envisioned  errors  defined; 

* How  friendly  are  the  system  interfaces  to  the  users? 

* Where  are  the  operational  bottlenecks? 

* Are  there  any  serious  single-point  failure  points? 

FINAL  POINTS 


It  can  be  seen  that  the  various  ,,User  Requirements  Surveys11  have  not  asked  the 
right  questions,  or  at  least  have  not  asked  the  questions  within  a milieu  to 
allow  the  user  to  respond  with  the  coefficients  required  by  the  system 
designer*  The  most  recent  system  survey  by  GSFC  has  taken  a step  in  the  right 
direction  by  presenting  to  the  users  several  potential  systems  among  which  the 
users  were  to  indicate  the  relative  usefulness.  But  the  necessary  grossness 
of  the  differences  prevents  any  fine  tuning  of  the  parameters. 

It  is  not  clear  that  this  fine  tuning  is  even  possible,  given  the  diversity  of 
users  within  each  discipline,  let  alone  among  the  disciplines.  No  plateaus 
of,  say,  registration  accuracy,  have  been  found  beyond  which  there  is  a marked 
loss  of  utility  of  the  data.  The  loss  of  utility  with  poorer  performance  has 
not,  perhaps  cannot,  be  stated  for  the  various  disciplines.  And  the 
aggregation  of  the  losses  will  produce  a loss  curve  with  a gradual  slope,  with 
no  cliffs. 


In  the  long  run,  it  may  well  te  found  that  all  of  the  potentially  obtainable 
information  is  already  in  the  user  surveys  which  are  available  and  that  users 
really  cannot  define  their  coefficients,  much  less  anticipate  the  coefficients 
of  others.  This  is  the  "lev  complexity"  end  of  the  spectrum.  In  this  case, 
tb  advances  in  system  performance  will  be  more  technology  driven,  and  the 
users  must  make  of  it  what  they  will.  (In  any  event,  once  a system  is 
designed,  this  is  the  situation.)  It  then  remains  to  the  system  personnel  to 
define  what  data  quality  results  at  various  points  in  the  system,  and 
hopefully  ^ o allow  the  users  to  obtain  data  ot  various  quality  to  suit  their 
needs.  The  system  error  model  will  be  used  to  do  the  evaluation,  identify  and 
remove  successive  error  predominant  sources,  to  provide  ever-better  data  to 
the  users,  and  to  serve  as  a source  of  information  for  subsequent  systems. 
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Figure  3.  Model  and  System  Complexity  Optimization 
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BY  VARIOUS  DISCIPLINES 


Figure  4.  Data  System  Block  Diagram 


Figure  5.  Design  Model  for  Data  System  Optimization 
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Figure  u.  Design  Model  tor  lut'ormaCioti  System  Optimization 
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VARIABLE  A 

A HAS  A MAX,  NO  PREFERRED  VALUE  FOR 
B.  MAX  OF  A DOES  NOT  DEPEND  ON  B 


A AND  B EACH  HAVE  A MAX,  BUT  THERE 
IS  NO  DEPENDENCE  OF  ONE  ON  THE 
OTHER.  EACH  MAY  BE  OPTIMIZED  SEP- 
ARATELY. 


VARIABLE  A 
A HAS  A MAX  WHICH  DEPENDS  ON  THE 


THE  MAX  OF  A AND  THE  MAX  OF  B ARE 
INTERRELATED  WITH  ONE  BROAD  CO-MAX 
POINT 


Figure  V.  Interaction  of  Sensitivity  Coefficients 


Figure  S.  System  Operating  I’oint  Selection 


"CORRECT 


Figure  9*  System  Error  ISud^eL  Model 
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8.4  modeling  misregistration  and  related  effects 

ON  MULTISPECTRAL  CLASSIFICATION* 

Fred  C*  Billingsley 

Jet  Propulsion  Laboratory,  Cslifornis  Institute  of  Technology 
Pasadena,  California  91109 


INTRODUCTION 

Spectral  analysis  generally  takes  the  form  of  multispectral  classification 
in  which  the  classification  is  done  by  comparing  the  sample  measurement  vector 
to  the  statistics  of  the  set  of  known  material  vectors  (training  statistics) 
representing  all  possible  classes,  and  by  using  one  of  several  decision  methods, 
determining  which  of  the  knowns  it  most  nearly  matches. 

The  problem  pursued  will  be  the  effects  of  misregistration  on  the  accuracy 
of  multispectral  classif ication  in  answer  to  the  question: 

What  are  the  effects  on  multispectral  classification  accuracy  of 
relaxing  the  overall  scene  registration  accuracy  from  0.3  to  0.5 
pixel? 

The  misregistration  is  but  one  of  a group  of  parameters  (noise,  class 
separability,  spatial  transient  response,  field  size)  which  must  all  be 
considered  simultaneously • The  thread  of  the  argument  (which  will  be 
discussed  in  detail  below)  is  this:  any  noise  in  the  measurements  (due  to  the 

scene,  sensor,  or  the  analog  to  digital  process)  causes  a finite  fraction  of 
measurements  to  fall  outside  of  the  classif ication  limits.  For  field 
boundaries,  where  the  misregistration  effects  are  felt,  the  misregistration 
causes  the  border  in  a given  (set  of)  band(s)  to  be  closer  than  expected  to  a 
given  pixel,  so  that  the  mixed  materials  in  the  pixels  causes  additional 
pixels  to  fall  outside  of  the  class  limits.  Considerations  of  the  transient 
distance  involved  in  the  difference  in  brightness  between  adjacent  fields, 
when  scaled  to  "per  pixel",  allows  the  estimation  of  the  width  of  the  border 
zones.  The  entire  problem  is  then  scaled  to  field  sizes  to  allow  estimation 
of  the  global  effects. 

This  approach  allows  the  estimation  of  the  accuracy  of  multispectral 
classification  which  might  be  expected  for  field  interiors,  the  useful  number 
of  quantization  bits,  and  one  set  of  criteria  for  an  unbiased  classifier. 


*This  paper  presents  the  results  of  one  phase  of  research  performed  at  the 
Jet  Propulsion  Laboratory,  California  Institute  of  Technology,  sponsored  by 
the  National  Aeronautics  and  Space  Administration  under  Contract  NAS;-100. 
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CONCLUSIONS 


The  following  briefly  stated  conclusions  are  developed  in  detail  in  the 
body  of  the  report* 

o The  difference  between  0.3-and  0.5-pixel  misregistration 
is  in  the  noise  for  multiapectral  clarification* 

o Precision  users  may  have  to  reregister  image  segments  any* 
way,  making  extreme  registration  precision  by  the  system 
of  less  importance* 

o Interpolation  algorithm  choice  is  relatively  unimportant , 
provided  a higher-order  interpolator  is  used. 

o If  small  fields  are  important,  small  pixels  are  more  important 
than  sensor  noise  contributions* 

In  addition,  several  observations  result: 

o System  registration  to  1-2  pixels  should  satisfy  users 
of  film  products* 

o There  is  a grey  area  of  0.5  to  1-2  pixels  in  which  the 
requirements  for  high  precision  are  not  well  justified* 


THE  BASIC  MODEL 

The  expected  effect  of  misclassif icat ion  may  be  estimated  by  a simple 
first-order  approach,  because  the  differences  in  classification  accuracy 
between  the  many  classification  schemes  and  conditions  that  have  been  tested 
are  overshadowed  by  the  vagaries  in  the  data  and  assumptions  in  the 
classification  process,  so  that  higher  order  analysis  will  contribute  little 
additional  understanding. 

Consider  first  the  probability  of  correct  identification  of  a field 

interior  pixel.  Field  interiors  are  nonuniform  because  of  the  combined 
effects  of  sensor  noise,  scaled  to  equivalent  reflectivity  (NEAp  ) and 

inherent  nonuniformit ies  in  the  field  itself.  The  overall  brightness 
distribution  iz  considered  to  be  Gaussian  - this  is  approximately  true  for 
field  interiors,  although  the  distribution  deviates  considerably  toward 
bimodal  for  nixed  materials  at  field  borders. 

The  combined  . ffect  of  these  various  noise  sources  produces  a finite 
probability  of  mi sciaasif ication.  (Figure  S-l)  The  fir6t-order  estimate 

considers  the  total  variance  caused  by  the  scene,  sensor  and  quantitation  as 
compared  to  the  defined  class  site  limits,  however  these  are  determined. 
Similar,  but  relatively  second-order,  effects  oay  be  expected  with  a higher 
order  analysis.  tioper  classifier  training,  resulting  in  accurate  limits,  is 
essential  (Hixson  et  al,  1980). 

For  simplicity,  and  because  of  the  later  desire  to  misregister  one  (or 

more)  of  the  bands,  the  discussion  will  assume  that  spectral  bands  as  sensed 

will  be  used,  and  that  for  recognition,  the  unknown  pixel  must  fall  between 
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appropriate  limit*  in  every  band  tested.  Therefore,  brightness  outside  of  a 
limit  in  any  one  band  is  sufficient  for  rejection,  so  that  ve  need  to  consider 
only  one  band  at  a time. 

The  probability  of  a sample  being  within  the  class  limits  can  be  derived 
by  assuming  that  an  ensemble  of  clean  signals  from  a aeries  of  areas  of  the 
same  material  can  be  anywhere  within  the  quantising  range  with  uniform 
probability,  but  that  individual  samples  are  perturbed  by  the  Gaussian  noise 
with  a distribution  equal  to  cr  . The  probability  distribution  of  the  signal 
plus  noise  is  found  by  convolving  the  probability  distribution  of  the  signal 
with  that  of  the  nois*.  The  probability  of  correct  class  assignment  (i.e., 
the  pixel  is  within  the  class  limits)  is  then  found  by  integrating  the 
probability  distribution  between  appropriate  class  limits  (Friedman  1965). 
The  resuH  of  this  calculation  is  shown  in  Figure  S-2.  In  the  useful  range 
of  (3  (3<p<  7),  the  curve  can  be  approximated  by 

P log  P - - 0.40 

where  P * probability  of  correct  classification,  and 
a class  size 

P* , with  class  size  end  a in  the  same  units. 

o scene 


Sources  of  noise  will  be  the  scene  itself  and  the  sensor,  both  assumed  to 
be  random  for  this  analysis*  The  root  mean  square  (rms)  sum  is  taken  to  give 
the  total  effective  noise*  A number  of  pixel  measurements  may  be  averaged 
together  to  reduce  the  noise  before  classification*  This  final  noise  figure 
•ay  oe  compared  to  the  vidth  of  the  class  to  give  (3  , from  which  the 
probability  V of  correct  classification  may  be  estimated*  This  leads  to  the 
Classification  Error  Estimator,  Fig*  S-3. 

As  an  example,  consider  a scene  having  a field-interior  variation  of  3%, 
to  be  viewed  with  a sensor  having  a total  noise  figure  of  12.  The  total 
effective  noise  seen  by  the  classifier  (upper  left)  will  be  the  rms  sum  of 
these,  or  3*162,  which  for  a total  0-255  digital  number  (dn)  range,  would  be 
6.1  dn.  If  the  class  width  (determined  by  the  classifier  algorithm)  is  25  dn 
(right  center)  the  P*  3.1,  giving  P • 0.742  (right  lower).  If  this  P is 

not  accurate  enough  for  the  analysis,  several  pixels  must  be  averaged( right 

upper):  a 2x2  averaging  will  raise  (3  to  6*2,  giving  a new  P * 0*86* 

Considering  p in  this  way  allows  an  estimation  of  the  total  noise 
permissible  as  it  affects  the  attainable  classif ication  accuracy.  If  the 
amount  of  scene  noise  to  be  encountered  in  s given  classification  task  can  be 
estimated,  the  allowable  extra  noise  from  the  sensor  and  quantization  can  be 
specified  by  estimating  the  loss  of  accuracy  of  the  classif ication  caused  by 
quantization  error*  This  leads  to  an  estimate  of  the  number  of  bits  which 

will  be  useful. 


Define  the  perfect  sensor  as  having  no  random  noise  nor  quantization  error 
vi.e.,  an  infinite  number  of  bits)*  This  will  define  (for  nxn  pixels  averaged) 


p„ 


class  size 


scene 


and  p - l£f°'Vpo 
o 
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For  the  reel  eeneor,  (3<P0  beeeuee  of  the  finite  0,en«or  *nd  aquentitetion‘ 

The  new  probability  of  correct  claeeif ication  F ia  related  to  PQ  by: 

P - Pc(p/po) 

A plot  of  the  lots  in  classification  accuracy  vs.  P0  is  given  in  Figure 
S-4,  for  the  paraseter  faailies  P/Po  and  o $e n#or/  °,cene*  Noise 

allocation  starts  with  defining  the  desired  P0  and  ascertaining  that  the 
required  P0can  be  obtained.  Definition  of  the  allowed  AP  determines  (e.g., 
from  the  graph)  the  allowed  a*ensor^  0 scene*  An  estimation  of  the  scene 
noise  for  which  the  other  conditions  apply  allows  the  calculation  of  the  to*al 
sensor  noise  allowed.  The  final  step  is  to  partition  this  noise  between 
sensor  random  noise  and  quantitation  noise. 

For  example,  let  the  desired  P0  * 852  and  allow  no  more  than  22  loss 

due  to  the  total  sensor  noise.  The  no-sensor-noise  po  must  be  £5.7  Lo  give 

P0.  Then,  from  Figure  S-4,  the  allowed  asensor  * 0*6  * ^ scene*  2f 

the  scene  has  a ° »cene  * 22,  the  allowable  aiensor  * 0.6x22  * 

1.22,  which  must  be  partitioned  between  NEAp  and  the  quantization  noise. 
For  NE  Ap  * 12,  the  allowable  o qUflnt  * \ 1.2Z " 1*  ' * 0.662,  which 
can  be  met  by  6-bit  quantization. 

Two  observations  are  important  here:  (1)  Increasing  the  number  of  bits  of 

quantization  produces  improvements  which  asymptotically  approach  zero,  as  each 
successive  bit  reduces  the  step  size  by  a factor  of  1/2.  (2)  A scene  having 

as  little  as  22  variation  is  a very  uniform  scene.  Since  this  noise  i6  rms’d 
with  the  sensor  noise,  it  will  overwhelm  any  but  a very  noisy  sensor. 

Therefore,  for  purposes  of  multi-spectral  classification,  more  than  six  bits 
would  seem  to  be  unnecessary. 


EDGE  EFFECTS 

To  this  point,  the  analysis  i6  based  on  pixels  well  inside  uniform  fields 
and  well  away  from  field  boundaries.  A number  of  experimenters  have  spent 
appreciable  time  discovering  that  classification  accuracy  falls  off  at 

boundaries  due  to  what  has  become  known  as  the  mixed-pixel  effect.  We  will 
start  at  that  point  and  attempt  to  model  the  effect  to  allow  us  to  quantify 
our  expectations. 

We  assume  as  a starting  point  that  all  the  spectral  bands  used  in 

classif icat ion,  whether  obtained  from  one  date  or  series  of  dates,  are  in 
perfect  registration.  This  means  that  when  the  pixel  grids  from  each  band  are 
aligned  the  data  contents  (field  borders,  road6,  all  features)  are  also 
aligned  - note  that  thi6  is  more  than  simply  having  all  internal  disto  tions 
removed,  which  is  all  that  most  geometric  rectifications  accomplish. 
Mif registration  will  (later)  be  considered  as  the  lack  of  alignment  of  the 
pixel  grids;  because  the  computer  can  only  work  with  pixel  grids,  aligning 
these  pixel  grids  appears  to  the  computer  as  a shift  in  the 

boundaries.  We  will  assume  that  training  samples  are  accurate  and  that  class 
limits  have  been  set  from  these  by  the  classifier  chosen.  The  classification 
is  modelled  as  follows:  signature  shifting  in  any  individual  band  will  tend 

to  cause  misclassif ication,  so  that  the  situation  may  be  treated  one  band  at  a 
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tine.  The  effects  of  pixel  mixture  in  ell  bends  may  then  be  ras'd  together  if 
desired.  The  entire  enelysis  simplifies  to  the  consideretion  of  the  trensient 
intensity  snift  across  field  boundaries  as  compered  to  the  class  limits  and 
the  noise  components  of  the  measurement. 

The  first  step  in  analysing  the  spatial  extent  of  pixel  mixing  across 
borders  is  to  estimate  the  shape  and  extent  of  the  transient  intensity  shift. 
If  the  impulse  response  functions  or  the  modulation  transfer  functions  (MTFs) 
of  the  various  components  (and,  hence,  the  entire  system)  are  known,  a precise 
transient  response  may  be  calculated.  For  example,  the  specifications  for  the 
Thematic  Happer  for  Landsat  D call  for  a 22  to  982  time  equivalent  of  about  2 
pixels  implying  a 102-902  transient  response  of  about  1.3  pixel.  The 
practical  result  of  thia  is  Chat  the  "infinitely  sharp"  edges  of  the  real 
scene  will  be  softened  by  the  filtering  effect  of  the  scanning  aperture 
(assumed  to  be  rectangular  and  having  uniform  response)  and  it  is  this 
softened  transient  response  which  is  sampled.  Interpolation  required  for 
registration  will  cause  some  further  softening,  and  the  use  of  any  of  the 
competent  higher-order  interpolation  functions  (sinx/x,  TRW  cubic  convolution, 
modified  cubic  convolution,  other  splines)  will  have  minor  effects  of  the  rise 
time.  A total  t10-90  (transient  response  from  102  to  902)  of  1.5  pixels 
with  no  ringing  vi~ 1 be  used  as  a surrogate  global  value. 

The  transient  situation  across  a border  is  sketched  in  Fig.  S-5.  We  are 
concerned  here  with  the  decrease  in  probability  that  a given  pixel  will  have  a 
value  within  the  class  limits  as  that  pixel  moves  toward  the  boundary,  a6 
shown  in  Figure  S-6.  The  analysis  only  needs  to  determine  the  area  under  the 
mormal  curve  (assuming  the  noise  is  Gaussian)  between  the  limits  as  determined 
by  the  classification  class  size  and  the  offset  from  the  "field  interior  value" 
caused  by  the  mixture.  The  important  scaling  involved  is  the  amount  of  signal 
shift  caused  by  tha  transient  total  shift  T,  as  related  to  the  desired  class 
size  S,  for  a given  P . The  left  portion  of  Figure  S-7  reflects  this  shift  in 
brightness  (vertical  axis)  as  it  affects  the  area  within  the  class  (the 
probability  of  recognition). 

The  transient  rise  distance  estimated  for  the  Thematic  Mapper  has  very 
close  to  a Gaussian  shape  and  a T10-90  * 1*5  pixel.  The  amount  of 
brightness  shift  is  the  difference  between  the  brightness  of  the  field  under 
consideration  and  the  adjacent  field  which  is  causing  the  shift.  The 
important  intensity  relation  is  the  magnitude  of  this  shift,  T,  as  related  to 
the  size  S of  the  class  being  tested  by  the  ratio  T/S.  These  curves,  for 
various  T/S,.  are  combined  with  the  probability  curves  of  the  previous 
discussion  in  Figure  S-7.  From  this  may  be  estimated  the  loss  in  probability 
in  classification  of  pixels  near  borders. 


BIAS  IN  FIELD  SIZE  ESTIMATION 

It  can  be  appreciated  that  several  things  are  happening  simultaneously: 
If  the  lower  limit  of  field  B and  the  upper  limit  of  field  A have  a gap 
between,  pixels  "lost"  by  field  B will  not  be  picked  up  by  field  A,  and  will 
be  considered  unknowns  and  not  be  counted  in  either  field.  The  lost  pixels 
will  be  some  interior  pixels,  due  to  insufficient  P , and  a large  number  of 
near-border  pixels,  resulting  in  apparent  field  sice  loss.  Only  if  the  lower 
limit  of  field  B and  the  upper  limit  of  field  A are  coincident  will 
pixels  lost  from  one  field  be  picked  up  by  the  other,  and  vice  versa,  to  give 
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complete  account  of  all  pixels.  For  the  field  size  estimator  to  be  unbiased, 
the  loss-and-pickup  in  both  directions  mutt  cancel;  that  is,  on  the  average 
the  true  border  must  be  located.  The  total  effect  will  depend  on  the  ratio  of 
the  number  of  border  pixela  to  the  number  of  field-interior  pixels,  and  hence 
is  • furction  of  the  field  shape  and  site. 

This  leads  directly  to  the  required  algorithm  for  field  sise  estimation: 
First  divide  the  scene  i'  to  blobs,  each  of  which  is  sufficiently  v -'orm,  and 
with  closed  boundaries.  Then  for  each  blob  (field)  determine  t:.~  average 
brightness  for  all  the  interior  pixels  which  are  safely  away  trcm  the  border. 
For  each  segment  of  the  border,  the  correct  field  edge  decision  level  is 
midway  (in  a '*)  between  the  average  brightness  of  the  two  fields  on  either 
side.  After  the  borders  are  located  using  this  criterion,  the  field  interiors 
may  be  reclassified  using  the  classification  limits  as  determined  from  the 
training  samples. 


EFFECTS  OF  MISREGISTRATION 

In  preparation  for  estimation  of  the  misregistration  effects,  an  analysis 
will  first  be  made  of  the  expectations  of  registered  data  and  the  sensitivity 
to  the  various  parameters  estimated.  The  starting  model  used  ha*  rectangular 
fields  aligned  with  the  pixel  grid.  Pixels  arc  grouped  into  four  tones:  1) 

Interior  (i)-those  with  centers  2 or  more  pixels  inside  borders,  2)  Inne 
border  (ib)-pixels  with  centers  1-1/2  pixel  inside  borders,  3)  Outer  border 
(ob)-pixels  with  centers  1/2  pixel  inside  borders,  4)  Exterior  border 
(xb)-pixels  outside  the  borders,  with  centers  1/2  pixel  outside.  Estimates  of 
classification  accuracy  for  each  tone  are  obtained  from  Figure  S-7.  The  tot*1 
estimate  of  classification  accuracy  is  the  sum  of  pixels  in  *ach  rone 
multiplied  by  the  corresponding  tone  accuracy  estimate.  Late-,  the  field  will 
be  misregistered , changes  in  the  number  of  pixels  in  each  tone  calculated,  and 
the  probabilities  again  sunned.  The  following  parameters  are  required: 

r - the  field  shape  ratio,  length  of  long  side/length  of  short  aide 
T - transient  brightness  difference  between  field  being  considered 
and  its  neighbor 
S - decision  class  site 

t - transient  distance  for  10X  to  90X  response 
P - class  site  S/a  of  Gaussian  noise 

The  following  global  values  selected  for  the  parameters  are  considered  to  be 
representative : 

r « 2 

T/S  « 1 to  5 

t • 1.5  pixels 

p * 3 to  5 

After  the  parameters  r,  T/S,  T , and  p are  selected,  the  resultant  (from 
Fig.  S-7)  probabilities  are  substituted  fur  the  brightnesses  in  the  various 
tones  to  produce  a "probability  image"  aligned  with  the  desired  output  pixel 
grid.  The  probability  assigned  to  a pixel  at  a given  location  represents  the 
probability  that  that  pixel  will  have  a brightness  falling  within  the 
classification  limit  determined  by  the  classifier,  for  the  given  spectral 
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band.  The  total  probability  of  correct  claaaification  it  given  by 


TO1 


pin' 


* pibnib  + pobnob  * pxbnxb  j 


where  n^  ia  th  field  width  (ahort  aide)  in  pixels,  and  n£,  n^,  ncb, 
n*b  *re  the  number  of  pixels  in  the  various  cones.  Using  these  values,  the 
global  estinate  of  the  probability  of  correct  classification  with  no 
misregistration  is  given  Figure  S-8  for  three  values  uf  T/S.  The  predominant 
effect  is  the  pixel  mixture  (the  effect  of  T/S).  As  expected,  this  is  worst 
for  small  fields  (ni  small)  because  of  the  larger  *r ^rcentcge  of  border 
pixels  for  these  fields.  Mote  that  for  T/S  ■ 1,  decision  level  midway  between 
brightnesses  of  adjacent  fields,  no  probability  loss  occurs,  even  with  small 
fields.  Unfortunately,  this  desirable  condition  cannot  be  systematically 
obtained. 


MISREGISTRATION  OF  CONGRUENT  FIELDS 


The  initial  model  for  misregistration  is  a displacement  of  d pixels,  eq-al 
in  both  x and  y.  The  result  of  this  misregistration  is  that  some  -re^  is  lost 
from  the  external  border,  causing  a fv  ther  classification  accuracy  decrease. 
The  misregistration  loss  as  seen  by  the  external  border  loss  is  given  by 


- o„b  [d  H-1 4 + - ih^-] 


The  basic  character  of  this  misregistration  loss  term  is  1/nj,  so  that  it 
will  have  a slope  approximately  equal  to  -1  on  a log-log  p’ot  vs  n^.  The 
precise  results  depend  critically  on  the  vilues  of  pxb  estimated  for  the 
Pxb  from  Figure  S-7: 


T/S 

,8 

T - 1 T - 1.5  T • 2 

3 

.10  .14  .20 

1 

5 

.02  .025  .07 

7 

0 .01  .04 

3 

0 0 0 

2 

5 

7 

0 0 0 

n n n 

Using  these  values,  the  loss  AP  due  to  displacement  misregistration  is 
plotted  in  Figure  S-9  for  various  parameter  combinations. 


MISREGISTRATION  DUE  TO  NON-CONGRUENCE 
1.)  SIZE  AND  RATIO  (ASPECT)  CHANGES 

Size  and  aspect  ratio  changes  can  come  about  from  several  c - f.  such  as 
scan  velocity  or  altitude  changes,  and  if  uncompensated  can  cause  additional 
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misregistration  error*.  Progressive  misregistration  from  a point  of  accurate 
registration  will  be  caused  by  both  causes  (Figure  S-lOa);  the  modeling  of 
this  effect  considers  first  that  sire  changes  H “ n'/n  will  cause  a shift  in 
points  a to  points  n'  both  vertically  and  horizontally , and  then  that  changes 
in  aspect  ratio  will  cause  further  shifts  in  the  horizontal  position  of 
vertical  borders  by  changing  the  field  shape  ratios  by  the  factor  R “ r'/r. 
The  resulting  shifts  are: 


A Gy  • (R  - 1)  tty  and  An^  • (NR  - 1)  rnv 


Fur  analysis,  this  shift  will  be  divided  around  the  bordera  synsnetrically  as 
optimum  field  registration  is  accomplished  (Figure  S-lOb).  Two  cases  must  be 
distinguished  (using  scan  velocity  as  a surrogate  cause): 

Case  l:  A slow  scan  decreases  pixel  spacing  and  puts  more  pixels  into  a 
given  field.  When  these  are  placed  into  the  output  grid,  the  field  appears 
stretched.  The  field  as  defined  by  the  other  (correct)  bands  now  covers  only 
part  of  the  stretched  field,  so  that  the  classification  tends  to  see  only 
interior  pixels,  and  the  accuracy  will  increase,  ultimately  reaching  the 
field-interior  accuracy.  The  sizes  of  the  border  errors  are: 

ei  * "2  (N  - 1)  nj  and  *2  m ~2  ~ 1)  rn^ 


Case  II:  A fast  scan  has  the  opposite  effect,  causing  the  field  to  appear 
smaller  and  the  analysis  pixels  defined  by  the  other  bands  now  include  more 
exterior  pixels.  The  classification  accuracy  will  decrease. 


For  fast  scan,  the  smaller  apparent  field  covers  an  area  expressed  as  a 
fraction  f^  of  the  total* 


Fractional  Areas: 


I 

I 


f . - 


r'(Tfl)  m _..2 
rn? 


-7—  - RN 


xo 


2Nni  + 2NRn|r  + 4 


(Interior) 


(External  Border) 


The  total  expected  probability  is 


ptot  “ fiPi  4 f*b  Pxb  * 

Since  the  external  border  pixels  are  now  included  within  the  analyzed 
field,  but  with  a low  probability,  the  fractional  area  RN^  represents 
approximately  the  fraction  of  the  basic  field-interior  accuracy  *~o  be 
expected.  Since  the  total  size  shrinkage  < in  pixels,)  is  sma  for  small  n^, 
only  larger  need  be  considered,  * the  l/n{  term  may  be  dropped. 
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This  allows  F(0t  to  be  approximated  for  r • 2 by: 


Ptot  ~ W2Pi  ♦ -^-Pxb 
“l 

For  large  fields,  Che  probability  is  seen  to  be  independent  of  field  sise,  and 
only  weakly  dependent  (because  of  low  pgb)  for  small  sixes. 

2.)  WAVY  BORDERS  AND  MULTIPLE  ACQU 1ST IONS 

For  single-band  analysis,  with  borders  distorted  so  that  there  are  pixels 
both  inside  and  outside  of  the  analyzed  area,  some  pixels  will  have  increased 
probabilities  of  correct  classification  and  some  will  have  less.  The  decrease 
in  probability  across  border  is  (very)  approximately  linear,  so  that  the 
(signed)  average  displacement  will  model  the  effect. 

For  multi-band  analysis,  those  pixels  having  a low  probability  of 
classification  will  have  the  largest  effect  as  the  net  probability  at  each 
pixel  location  is  the  product  of  the  probabilities  obtained  for  each 
acquisition  (band).  In  this  case  the  xms  displacement  will  produce  a better 
model  of  the  effects. 


SOME  OBSERVATIONS 

I.  ON  BASIC  CLASSIFICATION 

o The  total  noise  figure  (compered  to  the  class  size  in  a given 

dete.' mi  nation)  controls  P , and  in  turn  controls  the  Mxitnum 
attainable  classification  accuracy.  However,  for  practical  range  of 
3v(i  v 7,  increasing  P has  only  a soderate  effect. 

o Because  of  this,  if  small  fields  are  most  important,  the  reflected 

energy  might  be  more  profitably  divided  into  smaller  pixels,  even 
at  the  expense  of  NEAf  . As  this  will  cause  an  increase  in  data 
rate,  optimum  coding  rhould  be  investigated.  The  poasible  noise 
introduced  in  reconstructing  the  data  will  cause  some  further 
decrease  in  the  overall  effective  NE^p  and  so  decreases  p . But 

since  there  is  smaller  aensitivity  to  p than  to  1/nj,  there  should 
be  a net  gain  in  utility. 

o Increasing  the  number  ot  bits  of  quantization  produces  improvements 
which  asymptotically  approach  zero,  aa  each  auccessive  bit  reduces 
the  step  size  by  a factor  of  1/2. 

o A scene  having  as  little  as  22  variation  is  .«  very  uniform  scene. 

Since  this  noise  is  rms'd  with  the  sensor  noise,  :t  will  overwhelm 
any  but  s very  noisy  sensor.  Therefore,  for  purposes  of 

multi-spectrsl  clsssif icstion,  sn  extreme  number  of  bits  would  seem 
to  be  unnecessary. 

II.  ON  EDGE  EFFECTS 

o For  accurate  field  sire  estimation,  the  decision  brightness  must  be 

halfway  between  the  brighnesaea  of  the  fields  on  either  aide  of  a 
given  boundary.  This  means  that  classifiers  sec  for  material 
identification  will  in  general  produce  errors  in  field  size.  But  the 
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f ield-interior  brightness  is  increasingly  hard  to  estimate  for  smell 
fields  because  of  the  fever  interior  pixels, 
o It  is  important  to  keep  the  transient  response  distance  and  the 
accompanying  sample  spacing  small*  to  get  as  many  pixels  into  a given 
ground  distance  as  possible*  Field  area  errors  become  large  at  n\ 
• 5 or  less*  The  transient  distance  must  also  be  matched  between 
spectral  banls. 


111.  ON  MISREGISTRATION 

o For  large  T/S  (i.e.f  2 or  more)  the  edge  effects  are  so  great  that 
the  base  probability  is  drastically  affected,  and  the  external  border 
pixels  have  tero  probability  of  being  within  the  class  limits*  For 
this  reason,  there  is  no  misregistration  effect  for  large  T/S* 

o Square  fields  show  the  most  misregistration  loss,  when  scaled  to 

nl* 

o A shape  ratio  r*2  is  believed  to  be  representative* 

o Misregistration  loss  decreases  with  higher  (3  • However,  these  losses 

in  general  are  sms*  l to  begin  with,  and  the  discussion  calling  for 
sacrifice  of  to  gain  smaller  1FCV  (more  pixels  n^  into  a given 
field)  would  teem  to  override* 

o Increase  in  t decreases  the  basic  accuracy  of  edge  pixels  and  also 

increases  the  misregistration  losses. 

o Geometric  rectification  and  registration  procedures  must  not  only 

xemove  the  internal  distortions  but  must  also  produce  pixels  on  a 
defined  (preferably  ground-referenced)  grid.  Current  procedures  do 
not  do  this.  Without  this  reference  grid,  users  will  have  to 

re-interpolate  before  mul t i— temporal  data  can  be  compared. 

o Scale  and  aspect  ratio  errors  will  have  only  minor  effects  on 

moderate-area  problems,  but  they  will  cause  problems  in  correlating 
over  large  distances. 

o Altitude  relief  displacement  will  require  users  to  use  many  control 

points  to  register  images  in  areas  of  high  relief. 

o Unless  standard  reference  grids  are  established,  users  requiring 

registration  will  have  to  interpolate  every  image,  even  in  low  relief 
areas. 

o For  single-band  analysis,  the  algebraic  average  of  the  displacement 

may  be  used.  For  multi-band  analysis,  with  erratic  errors  in 

location  among  the  bands,  the  lowest  probability  of  correct 
classification  holds  and  the  rms  of  the  displacements  is  appropriate. 
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AM  UNANSWERED  QUESTION 

This  report  models  the  potential  misregistration  effecta  on  aultiapectral 
:la*»sif ication  accuracy*  It  may  allow  the  comparison  of  the  various  teata  and 
simulations,  and  pointa  out  the  variables  which  must  be  reported  for  those 
simulations  to  allow  their  validation*  It  doea  not  anever  the  following 
queation:  Given  a certain  loaa  in  accuracy  due  to  niaregiatration,  how  does 

that  damage  the  ability  to  uae  the  data  analyaia  results?  These  evaluations 
will  be  discipline  dependent,  and  mat  be  sought  separately. 
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AREA  IS  PROPORTIONAL  TO 
PROBABILITY  OF  BEING 
WITHIN  THE  CLASS  LIMITS 


Figure  S-l  Effect  of  Noise  on  the  Probability  of  Correct  Multi- 
apectral  Claaaificatioo 


0 - CLASS  SIZE/rms  NOISE 


Figure  S-*  Cl  van  a Signal  Uni  f only  Probable  over  the  Dynaalc  Range,  and 

Cauaslan  Noise  with  standard  Deviation  • o . The  curve  shows 
the  Probability  of  Correctly  Recognising  a class  corresponding 
to  the  Noise-free  Signal  as  a Function  of  the  Ratio 
0 • class  siae  to  . 
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Figure  S-4  Loss  In  Clsssiflcstlon  Accuracy  due  to  Noise 
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PIXEL  SPACING 


Figure  S-5  Cross  Section  of  brightness  trees  ecross  e boundary  between 
two  fields,  showing  the  distance  required  for  the  bright- 
ness transition. 


Figure  S-6  the  distribution  of  "field"  pixels  moves  down  the  transition 
curve  as  the  measurement  point  moves  toward  the  boundary. 

The  shaded  area  is  the  proportion  which  trill  be  correctly 
classified. 
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nxa  CENTER  DISTANCE  FROM  BORDER  - PIXELS 

Figure  S-7  Combined  Curves  for  Translation  of  Pixel  Distance  from 

Border  to  Shift  in  the  Brightness  (Scaled  in  Units  of  Class 
Sits,  S ) to  Probability  of  Correct  Classification. 
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Figure  S-8  Probability  of  Correct  Classification  using  Global 
Parameters,  for  Perfectly  Registered  Pixels. 

One  Spectral  Band  Only. 
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o.  GENERAL  CASE 


b.  EE  ST  REGISTRATION  CASE 

(NO  TRANSLATION  DISPLACEMENT) 


Figure  S-10  Construction  for  Estimating  Misregistration  Caused 
By  Slxe  and  Aspect  Errora. 


426 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


AP,  % 


Figure  S-9  Loss  of  Classification 
‘Accuracy  due  to  Misregistration  of 
One  Band,  for  Various  Parameter  Com- 
binations. 

/?■  Class  site/a  of  noise 
T • Field  Shape  Ratio,  long/short  sides 
T ■ 10-90X  transient  distance 
nj  " length  of  short  side,  pixels 
d • displacement,  pixels 
A?  • loss  in  probability 
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3.5  an  AUTOMATED  MAP.' INC  SATELLITE  SYSTEM* 

Alden  P.  Colvocoresses 
U.S.  Geological  Survey 
National  Center,  Mail  Stop  ?^j20 
Reston,  Virginia  22092 

Abstract 


Throughout  the  world;  topographic  maps  are  compiled  by  manually  operated 
stereoplotters  that  recreate  the  geometry  of  two  wide-angle  overlapping 
stereo  frame  photographs.  Continuous  imaging  systems  such  as  strip 
cameras,  electro-optical  scanners,  or  linear  arrays  of  detectors  (push 
brooms)  can  also  create  stereo  coverage  from  which,  in  theory,  topography 
can  be  compiled.  However,  the  instability  of  an  aircraft  in  the  atmosphere 
makes  this  approach  impractical.  The  benign  environment  of  space  permits 
a satellite  to  orbit  the  Earth  with  very  high  stability  as  long  as 
no  local  perturbing  forces  are  involved.  Solid-state  linear-array  ; -.nsors 
have  no  moving  parts  and  create  no  perturbing  force  on  the  satellite. 
Digital  data  from  highly  stabilized  stereo  linear  arrays  are  amenable 
to  simplified  processing  to  produce  both  planimetric  imagery  and  elevation 
data.  A satellite,  called  Mapsat,  including  this  concept  has  been 
proposed  to  accomplish  automated  mapping  in  near  real  time.  Image 
maps  as  large  as  L:50,000  scale  with  contours  as  close  as  20-m  interval 
nay  be  produced  from  Mapsat  data. 

Background 


The  geometry  of  stereo  mapping  photographs,  whether  taken  from  aircraft 
or  satellite,  is  well  known  and  documented.  Transforming  such  photographs 
into  topographic  maps  is  a relatively  slow  and  expensive  process  that 
for  many  critical  steps  defies  automation.  Compared  to  an  aircraft,  a 
satellite  offers  the  unique  advantages  of  much  greater  stability  and 
uniform  velocity. 

Utilizing  these  advantages,  a sensing  system  in  space  can  now  provide 
imagery  of  napping  quality,  even  though  a continuous  electro-optical 
imaging  system  is  used  instead  of  a mapping  camera  with  its  inherent 
high  geometric  fidelity.  The  next  generation  of  space  sensors  will 
include  solid-state  linear  arrays  (fig.  1)  that  involve  no  moving 
parts.  3y  continuous  imaging  with  very  high  geometric  fidelity  they 
will  permit,  at  least  in  part,  the  automated  mapping  of  “.he  Earth 
from  space  in  three  a3  well  as  two  dimensions.  The  fundamental  difference 
between  conventional  ana  continuous  stereo  methods  is  illustrated 
by  figure  2. 


* Approved  for  publication  by  Director,  U.S.G.S. 
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At  least  four  papers  have  been  published  that  relate  directly  to  automated 
three-dimensional  mapping.  In  1952,  Katz  (1)  showed  how  height 
measurements  could  be  made  with  a stereoscopic  continuous-strip  camera. 

The  geometry  of  such  a strip  camera  and  stereo  lirear  arrays  is  basically 
the  same.  In  1962,  Elms  (2)  elaborated  on  the  strip  camera  concept 
and  indicated  its  advantages  over  frame  cameras  as  a possible  component 
of  an  automated  mapping  system.  In  1972,  Helava  and  Chapelle  (3)  described 
the  development  of  instrumentation  by  which  a conventional  stereomode.1, 
can  be  scanned  using  the  eplpolar-plane*  principle,  and  thus  reducing 
image  correlation  from  a two-dimensional  to  a basically  one-dimensional 
task. 

In  "1976  Scaraiio  and"  Bhrumm;  described  the  automated  stereo-mapper 
AS-11B-X  which  utilizes  the  epipolar-scan  concept  and  one-dimensional 
digital  image  correlation  described  by  Helava  and  Chapelle.  Thus  the 
concept  of  reducing  photogranmetric  data  stero  correlation  iron  o 
to  one  dimension  Is  well  established.  The  cited  literature,  however 
does  not  describe  the  possibility  of  imaging  the  Earth  directly  in 
stereoscopic  digital  form  suitable  for  one-dimensional  processing. 

Beginning  in  1977  a serious  effort  to  define  a stereo  satellite  cr 
Suereosat  (5)  was  vndertaken  by  NASA.  The  Stereosat  concept  calls  for 
linear-array  sensors,  looking  fore,  vertical  and  aft,  but  its  principal 
objective  is  to  provide  a stereoscopic  view  of  the  Earth  rather  than 
to  map  it  in  automated  mode.  There  ...a  other  ways  of  obtaining  stereo 
imagery  with  linear  arrays.  The  French  SPOT  (6)  satellite  can  look 
left  or  right  of  the  track  and  thus  achieves  stereo  by  combining  imagery 
from  nearby  passes  of  the  the  satellite.  NASA's  Multispectral  Linear 
Array  (MLA)  concept  (7),  as  so  far  defined,  calls  foi  fore  and  aft 
looks  through  the  same  set  of  optics  by  use  of  a rotating  mirror. 

However,  neither  the  SPOT  nor  NASA's  MLA  approach  are  considered 
optimum  for  stereo  mapping  of  the  Faith,  as  neither  is  designed  to 
acquire  data  in  continuous  fort.. 

Mapsat  Geometric  Concept 

Linear  arrays  represent  a relatively  new  remote  sensing  concept.  Five 
papers  on  this  subject  were  presented  at  the  ASP/ACSM  annual  convention 
during  March  1978  (8,9,10,11,12).  These  papers  concentrated  on  detector 


*An  epipolar  plane  is  defined  oy  two  air  or  space  exposure  (imaging) 
stations  and  one  point  on  the  ground. 
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technology  and  the  application  of  linear  array  sensors  in  a vertical 
imaging  mode.  W^sh  (13)  recently  described  the  geometry  of  linear  arrays 
in  stereo  mod*:,  although  his  error  analysis  for  such  a system  is  based  on 
measurements  made  from  images  rather  than  computations  based  on  the  digital 
data* 

3v  combining  the  technology  of  linear  arrays,  the  concept  of  epipolar- 
plane  scanning,  and  the  expert  ace  gained  from  Landsat  and  other  space 
sensing  systems,  Mapsat  was  defined  (14),  and  its  proposed  parameters  are 
listed  in  Table  1*  The  Mapsat  concept  was  the  work  of  several  individuals, 
but  perhaps  the  single  most  important  contribution  was  that  of  Donald  Light 
(verbal  communication),  then  of  the  Defense  Mapping  Agency,  who  first 
suggested  that  epa polar  planes,  as  described  by  Helaya  (3)  and  used  in  the 
AS-113-X  plotter,  could  be  achieved  directly  from  space  and  that  topographic 
data  might  then  be  extracted  in  real  time.  There  are  several  feasible 
configurations  by  which  linear  array  sensors  can  continuously  acquire  stereo 
data.  It  va s decided  tnat  the  system  must  permit  selection  from  the  three 
spectral  oands,  provide  fee  two  hase-tG-height  ratios  of  0, 5 and  1.0  and 
be  compatible  with  the  epipola.'  concept.  Figure  3 illustrates  the 
configuration  selected  to  accomplish  the  stereoscopic  as  well  as  monoscopic 
functions. 

Acquiring  stereo  data  of  the  Earth  in  epipoLar  form  directly  from  space  is 
the  fundamental  geometric  concept  of  Mapsat.  The  epip  'lar  conditions 
shown  in  Figure  4 implies  that  five  points — the  observed  ground  point  ?, 
the  two  exposure  stations  S and  S . and  the  two  image  detectors  f and  a — li 
in  a single  plane.  I this  epipolar  condition  is  maintained  as  the  satellite 
moves  along  its  orbit,  every  point  P observed  by  detector  f in  the  forward 
looking  array  will  also  be  observed  subsequently  by  detector  a in  the  aft 
looking  array-  Thus  image  correlation  can  be  obtained  by  matching 
the  data  stream  from  detector  f with  that  from  a — a one-dimensional 
correlation  scheme.  This  description  applies  equally  to  the  use 
of  the  vertical  with  either  the  fore-or  aft-looking  array  but  involves 
a weaker  (0.5)  base-t o-height  ra.io  than  the  described  use  of  the  fore 
and  ai**  arrays  (base-to-height  ratio  of  1.0).  In  practice  the  data  streams 
from  more  than  one  detector  may  be  involved  ~ince  there  will  normally  be  some 
offset  in  the  oath  of  a given  pair  of  detectors.  Moreover  under  certain 
conditions,  correlation  may  be  improve'  by  a limited  expansion  of 
the  correlation  function  to  two  ainens’ous. 


•0 
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Because  each  detector  array  is  looking  at  a different  portion  of  the 
Earth  at  any  given  time,  Earth  rotation  complicates  the  epipolar 
condition.  Aa  shown  in  figure  5,  this  complication  can  be  overcome 
by  controlling  the  spacecraft  actitude.  This  description  is  obviously 
simplified;  further  complications  involve  such  factors  as  the  ellipsoidal 
shape  of  the  Earth,  variations  in  the  orbit,  spacecraft  stability, 
and  even  very  large  elevation  differences.  The  spacecraft  position  and 
attitude- must  be  precisely  determined  by  such- systems  as  the  Global 
Positioning  Sv*»t«m  (GPS  or  NAVSTAR)  and  frequent  stellar  referencing. 
Satellite  attl.ude  control  Involves  gyros  and  inertial  wheels,  and, 
when  a satellite  is  free  of  perturbing  forces  created  by  moving  (actuated) 
parts,  attitude  can  be  maintained  for  reasonable  periods  to  the  arc-second. 

"Of  course,  the  sensing  system  nust  retain  precise  geometric  relationship 
to  the  attitude  control  system.  Defining  the  correct  satellite  attitude 
and  the  rates  in  yaw,  pitch,  and  roll  to  maintain  the  epipolar  condition 
requires  precise  mathemar ical  analysis.  Tvo  independent  analyses,  one 
by  Howell  of  ITEK  (15)  and  the  other  by  Snyder  (16)  of  U.S. 

Geological  Survey,  confirm  Mapsat' s geometric  feasibility,  and  a 
U.S.  patent  has  been  allowed  on  the  concept.  Table  2 indicates  the 
maximum  deviations  from  the  epipolar  condition  caused  by  the  various 
expected  error  sources.  This  table  is  based  on  a half  orbit  (50  minutes) 
which  covers  the  daylight  portion  to  which  imagery  is  basically  Limited. 
Attitude  rate  errors  would  be  considerable  if  only  corrected  once  every 
50  minutes  but,  as  the  table  indicates,  10-minute  intervals  based  on 
stallar  reference  reduce  the  errors  to  a reasonable  amount.  Ten-minute 
stellar  referencing  using  star  sensors  as  described  by  Junkins  et  al. , 

(17),  is  considerei  reasonable.  Computer  programs  have  been  developed 
that  result  in  the  epipolar  plane  condition  being  maintained  as  long  as 
adequate  positional  and  attitude  reference  data  are  available  and  proper ly 
utilized.  Figure  6 illustrates  the  simplicity  of  elevation  determination 
in  an  epipolar  plane  which  is  the  key  element  of  Mapsat. 

Obviously,  the  Mapsat  concept  can  be  effectively  implemented  only  if 
stringent  specifications  regarding  orbit,  stability,  reference,  and  sensor 
systems  a'  - met.  Table  3 lists  the  Mapsat  geometric  requirements  as  define 
to  date,  and  each  is  considered  to  be  within  the  state  of  the  art. 

Mapping  Accuracy 

By  meeting  the  geometric  requirements  indicated  and  achieving  stereo 
correlation,  the  resulting  mst.  accuracy  is  compatible  with  scales  as  large 
as  1:50,000  and  contours  as  -lose  as  20  m interval  based  on  U.S.  National 
Map  Accuracy  Standards.  Reference  15  covers  this  analysis  in  some  detail. 
Such  accuracies  result  from  the  indicated  geometric  requirements  and  the 
following  factors: 
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o Linear  e .-ray  detectors  are  positioned  with  sub-micron  accuracy. 

4 

o Optical  distortion  effects',  when  accounted  for  by  calibration, 
are  negligible. 

o .Atmospheric  refraction,  because  of  the  steep  look  angles,  is  of 
a very  low  order  and  i«  reasonably  well  known;  air-to-water 
refraction  is  also  known  where  underwater  depth  determination 
is  involved. 

o Relative  timing,  which  is  referenced  to  data  acquisition,  is 
accurate  to  within  the  microsecond. 

o Digital  stereo  correlation-,' where  uniquely  achieved,  provides 
three 'dimensional 'foot-mean-square  (rms)  positional  accuracy 
to  within  half  the  pixel  dimension. 

These  considerations  result  in  relative  positional  errors  for  defined 
points  of  only  6 to  7tn  (rms)  both  horizontally  and  vertically.  This 
vertical  accuracy  requires  the  1.0  base-to*-height  ratio.  Such  accuracy  is 
adequate  for  the  mapping  Indicated  but  assumes  that  control  is  available 
for  reference  to  the  Earth's  figure.  As  indicated  by  ITEK  (15)  and  the 
author  (19),  control  points  of  1,000  km  spacing  along  on  orbital  path  will 
be  adequate  for  such  a purpose.  Where  no  control  exists  the  absolute  accuracy 
of  the  resultant  maps,  with  respect  to  the  Earth's  figure,  may  be  in  rms 
error  by  50  to  100  m although  their  internal  (relative)  accuracy  remains 
at  the  6 to  7 m rms  level. 


Stereocorrelation 


The  determination  of  elevations  from  stereo  data  requires  the 
correlation  of  the  spectral  -esponse  from  the  sane  point  or  group  of  points 
as  recorded  from  two  different  positions.  In  the  aerial  photography  case 
these  two  positions  are  the  camera  stations,  whereas  with  linear  arrays  in 
space  the  two  recording  positions  are  constantly  moving  with  the  satellite. 

In  the  photography  case,  correlation  is  achieved  bv  orierting  the  two 
photographs  to  model  the  acquisition  geometry.  Once  this  is  done,  correlation 
can  be  achieved  by  the  human  operator,  or  the  image  stereomodel  tan  be  scanned 
ant  correlated  by  automated  comparison  of  the  signal  patterns  from  che  two 
photographs.  A system  such  as  the  AS-11B-X  (3,4)  generates  cne-dimensional 
digital  data  in  epipolar  planes  from  the  model.  Tn  theory,  epipolar  data  > 
should  be  correlated  much  faster  than  that  from  a system  that  must 
search  in  two  dimensions  to  establish  correlation.  In  practice,  the  automated 
correlation  of  digital  dat~  has  been  only  partially  successful;  and,  as  Mahoney 
(18)  has  recently  pointed  out,  correlation  by  either  manual  or  automated  systems 
is  still  a slow  and  costly  process.  To  date,  no  one  has  acquired  original  sensor 
data  in  epipolar  torm.  .s,  no  one  can  really  say  how  well  such  data  can  be 
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automatically  correlated,  until  a satellite  such  as  Mapsat  is  flown. 

Simulation  using  digitized  aerial  photographs  or  linear-array  stereo-sensing 
of  a terrain  model  are  relevant  experiments  worth  conducting.  However,  they 
will  provide  only  partial  answers,  since  the  degree  of  correlation  will  depend 
on  the  area  involved.  The  characteristics  of  the  Earth's  surface,  coupled 
with  related  conditions,  such  as  the  atmosphere  and  Sun  angles,  are  highly 
varied;  which  means  that  the  degree  of  correlation  will  also  be  highly  varied. 
This  problem  does  not  imply  that  the  Mapsat  concept  has  not  been  validated. 
Having  stereo  data  organized  in  linear  digital  form  is  of  obvious  advantage 
to  create  the  three-dimensional  model  of  the  Earth's  surface*  Many  areas 
will  correlate  in  one-dimensional  node,  others  will  require  two-dimensional 
treatment,  and  still  other  areas  may  not  correlate  at  all.  By  properly 
defining  the  satellite  parameters  and  data  processing,,  the  correlation 
fuBcciear  can  T)*"  optimized  and 'raised  velL  above  that  obtainable  from 
wide-angle  photography  systems.  For  example,  digital  data  can  readily  be 
modulated  to  enhance  contrast  or  edges  that  make  up  the  patterns  on  which 
correlatiou  dapends.  Photography  can  also  be  nodulated,  but  it  is  far  more 
difficult  (and  less  effective)  chan  digital-data  modulation,  as  film  lacks 
the  dynamic  ranga  and  sensitivity  of  solid-state  detectors.  Mapsat  will 
acquire  data  in  an  optimum  form  for  automated  correlation,  which  will  expedite 
the  precise  determination  of  elevations  and  create  digital  elevation  data 
that  are  becoming  a basic  tool  fcr  many  disciplines. 

Acquisition  Modes  and  Products 

As  previously  described  <’.4),  Mapsat  is  designed  to  be  operated  in  a 
wide  variety  of  nodes.  These  include  variation  in  resolution  (10-n  elements 
on  up),  spectral  bands,  swath  width,  and  stereo  modes.  Such  flexibility 
permits  optimum  data  acquisition  without  exceeding  a specified  data- 
transmission  rate  that  is  now  defined  at  48  megabits  per  second  (Mb/s). 

The  Earth's  surface  is  highly  varied,  and  data  product  requirements 
are  likewise  highly  varied.  By  varying  the  acquisition  modes  and,  in  turn, 
producing  a variety  of  products,  the  data  management  problem  beconec 
complicated  as  compared  to  existing  systems  such  as  Landsat  which  produces 
only  two  bauic  types  of  data.  However,  solving  this  data  management  problem 
is  a small  price  to  pay  for  a system  that  can  meet  a wide  variety  of 
requirements  for  remotely  sensed  data  of  the  Earth.  Only  four  primary 
products  are  expecced  from  Mapsat  as  follows: 

(a)  Raw-data  digital  tapes  from  which  quick-lbok  images  can  be 
displayed  in  near  real  time. 

(b)  Processed  digital  image  tapes  calibrated  both  radiooecri tally 
and  geometrically  to  a defined  map  projection.  Such  data  will  be 
two-dimensional  ( planimetric)  but  describe  the  Earth's  radiance 
(brightness)  in  multispectral  form  as  is  now  accomplished  by 
Landsat  Multispectral  Scanner  capes. 
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(c)  Processed  digital  tapes,  again  calibrated  both  radiometrically 
and  geometrically,  but  which  now  describe  the  Earth1 s surface 

in  three  dimensions  (topographically)  with  an  associated  radiance 
value.  Such  tapes  are,  in  effect,  digital  elevation  data  sets  of 
the  Earth* s surface^ 

(d)  Standardized  images,  both  black-and-white  and  in  color,  which 
include  geometric  corrections  and  radiometric  enhancements.  Such 
corrections  and  enhancements  will  be  of  recognized  general  value 
and  of  a type  that  can  be  performed  without  undue  delay  or 
excessive  cost.  The  images  would  also  be  of  standardized  scale. 

Erow  theae:  faux  basic  products*  a .wide  variety  of  derivatives  can  be  made  wfeiah* 
include  the  following: 

(a)  Black-and-white  and  multicolor  image  maps  and  mosaics  at  scales 

as  large  as  1:50,000,  or  even  1:25,000  (1:24,0(0)  where  nap  accuracy 

standards  are  not  required. 

(b)  Thematic  displays  and  maps  involving  such  subjects  as  land  cover 
and  land  use  classif ication. 

(c)  Maps  which  depict  the  Earth*s  topography  by  such  means  as  contours 
(as  close  as  20-tn  interval),  slopes,  elevation  zones,  shaded  relief, 
and  perspective  display. 

Conclusion 


Mapsat  will  not  meet  all  anticipated  remote  sensing  requirements, 
and  it  will  in  no  way  replace  those  air-photo  surveys  required  to  meet 
mapping  requirements  for  scales  larger  than  1:50,000  and  contour  Intervals 
of  less  than  20  ra.  What  it  will  do,  is  provide  a precise  three-dimensional 
mulcispectral  model  of  the  Earth  at  reasonable  resolution  and  in  digital 
form.  Moreover,  the  satellite  will  record  the  changing  responses  of  the 
Earth* s surface  as  long  as  it  is  in  operation. 

Mapsat  can  be  built  today  at  what  is  considered  t ^ be  a reasonable 
cost  (15)  as  it  is  based  on  available  components  and  technology.  Moreover, 
it  is  designed  for  simplified  operation  and  data  processing-  Assuming  that 
a*'  operational  Earth-sensing  system  will  be  flown,  surely  Mapsat  is  a 
deserving  candidate  for  such  a job. 
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Map sat  Parameters 


o Orbit — Same  as  Landsat  1,  2 and  3 (919  km  alt'. 

o Sensor — Linear  Arrays— Three  optics  looking  23°  forward,  vertical 
and  23°  aft.  Three  spectral  bands: 

blue  greea  0.47  - 0.57  um 
red  0.57  - 0.70  um 

near  IS.  0.76  - 1.05  um 

o Swath — 130  km  or  portion  thereof. 

o Resolution-Variable— Down  to  10  m element. 

o Transmission — S (or  X)  band,  compatible  with  Landsat  receivers 
but  with  rates  up  to  48  Mb/s. 

o Processing— One  dimensional.  Including  stereo. 


Table  1 
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Table 


Mapsat  Geometric  Requiremf.i.ts 

o Positional  Determination  of  Satellite— 10  to  20  mi/  in 
all  i.nree  axes. 

2/ 

o Pointing  Accuracy— Within—  0.1  of  vertical. 

2 / 

o Pointing  Determination — Within—  5 to  10  arc  seconds 

-o  Stability  of  Satellite— Rotational  rates  Withini/  10"*6 
degrees /second. 


y rms  (1c ) 

2/  very  high  probability  (3q) 


Table  3 
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DETECTORS 


Figure 


Untar  arrays  of  datectors  in 
focal  1G  to  30  ca  long 


Hapsat  Saasor  Coafijuracifln  (not  to  seal*) . 

Op  tics  A,  B.  and  C ars  a rigid  part  of  uctlUci. 
Optic  3 s«isc«  tha  same  strip  SO  saconds  liur  a.; 
optic  C,  U0  saconds  altar  A.  Any  combination  of 
A,  3,  and  C produca*  searao.  Optics  A and  C art 
of  about  !0Z  longsr  focai  iaagtii  to  provida 
raaolution  coopacibit  vitb  optic  3. 


Tigurt 
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figure 


Elevation  difference  as 
function  of  time 
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8*6  Concept  for  a Multiple  Resolution  Pushbroom  Sensor 

Fred  C.  Billingsley 

Jet  Propulsion  Laboratory,  California  Institute  of  Technology 
Pasadena , California  91109 


Abstract 


A general  purpose  “pushbroom''  sensor  will  have  parameters  determined  by  the  needs  of  the 
majority  of  potential  users.  These  parameters  may  not  satisfy  the  ; eeds  of  certain  users: 
Agriculture  requires  a very  short  return  visit  interval;  cartography  requires  a very  small 
pixel  sire;  Land  Use  and  Geology  would  be  satisfied  with  moderate  resolution  and  seasonal 
return  times.  The  aggregate  solution  of  these  needs  would  produce  a sensor  with  extremely 
high  data  rates.  A sensor  concept  is  proposed  which  may  meet  the  combined  needs  without 
the  extreme  data  rate. 


Coverage  Requirements 

The  various  disciplines  have  expressed  requirements  ranging  from  $-day  repeat  to  semi- 
annual repeat,  from  5-meter  to  60-meter  resolution,  various  spectral  band  combinations,  and 
reasonable  data  rates. 1 Fortunately,  all  of  the  requests  may  not  need  to  be  met  simultane- 
ously. The  various  requirements  seem  to  group  somewhat  as  follows; 


Agriculture;  Revisit  interval  5-8  days  to  pick  up  emergence  and  other  crop  calendar- 
related  events. 

Spatial:  High  resolution  (10-15  ro?)  to  pick  up  field  boundaries; 

coarser  resolution  would  suffice  for  field  interiors. 

Spectral:  Properly  placed  bands;  4 to  6 probably  sufficient. 

Mapping;  Revisit  interval  not  critical;  eventually  need  complete  cloud-free 

coverage . 

Spatial:  3-10  meter  resolution  needed  for  1; 24000  mapping. 

Spectral:  The  fine  resolution  may  be  panchromatic  or  principal  components. 


Geology;  Revisit  interval  should  be  seasonal  to  pick  up  variations  indicative 

of  the  geologic  information  desired. 

Spatial:  No  hard  requirement;  15  meter  is  a logical  next  step. 

Spectral:  Perhaps  7 oi  so  bands,  placed  for  soils  and  rock  recognition. 

Bands  probaLli  different  than  agriculture  bands. 


Land  Use:  Revisit  interval  perhaps  seasonally  or  semiannually. 

Spatial:  No  hard  requirement;  15  meter  is  a loqical  next  step. 

Spectral:  No  hard  requirement;  bands  placed  for  other  purposes 

may  sufiice. 


7-0 av  RE  VISIT 
AGRICULTURE  N 
COASTAL  PftQC  ' 


REAL  I IV t 
TRANSMISSION 
EPISODIC 
EVENTS 


7-15  m RESOLUTION 
MAPPING 
It  XT  USE 


altitude  oata 

GEOLOGY  - 

MAPPING 


GENERAL 

characteristics 

1 5-30  r*  RESOLUTION 
2-3  m>*th  REVISIT 
6-7  BANDS,  COMMAND  ABLE 
1-2  wk  DAiA  DELIVERY 
GEOMETRICALLY  RECTIFIED 
RELATIVE  INTENSITY  CALI6 


SPECIFIC  NARROW  BANDS 
GEOLOGY 
WATER  COLOR 


REAL -ENOUGH -II  ME 
BROWSE 
ALL 


EASTER  DATA  delivery 
AGRIC  12-36  N» 


REGISTERED  DATA 
LAND  USE 

ALL  TEMPORAL  USERS 


ABSOLUTE  RADIOM  c MJ8 
AGRICULTURE 
GEOLOGY 
COASTAL  PROCESSES 


As  there  are  no  firm  revisit 
requirements  nor  firm  resolution 
requirements,  a general  purpose 
sensor  might  be  designed  to  have 
15-30  meter  resolution,  seasonal 
revisit  interval,  6-7  spectral 
bands.  This  leaves  the  agricul- 
ture short  revisit  time  and  the 
mapping  of  line  pixels  as  major 
*tall  poles’*  which  are  not  satis- 
lied.  Figure  1 illustrates  the 
situation , 


Figure  1.  Parameters  of  a Gen- 
eral Purpose  Sensor  Will  Leave 
the  Tall  Poles  Unsatisfied. 
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Stravman  Solution 


A compromise  sensor  concept  is  proposed  based  on  the  proposition  that  all  tall  pole  para 
meters  need  not  be  met  simultaneously.  Specifically , if  revisit  time  can  be  traded  against 
resolution  <short  revisit  time  with  low  resolution  and  long  revisit  time  with  high  resolu- 
tion), the  data  rate  and  quantity  can  be  kept  within  bounds.  Spectral  aalection  will  be 
handled  using  the  imaging  spectrometer  technique.2,! 

The  revisit  time  sets  the  basic  parameters: 


Number  of  swaths  required  to  cover 


40,000  (kmt  earth  circumference) 
Equatorial  Spacing  (km7  • S) 


R • Revisit  Interval  • Swaths  x 100  minutes/swath  (approx.)  * ^ — Spicing — 5cm 
This  gives,  for  various  intervals: 


Annual 

R - 360 

00 

1 

to 

Semiannual 

180 

16 

Seasonal 

90 

32 

Monthly 

30 

96 

Weekly 

7 

411 

The  actual  swath  width  should  be  some  comfortable  amount  larger  than  S to  allow  for  van 
at  ions  in  orbit,  etc.  Considering  the  potential  for  orb;t  control,  xet  the  swath  width,  K, 
be  S ♦ 1C  km,  rounded  to  some  convenient  size. 


What  now  remains  is  to  find  an  orbit  which  simultaneously  meets  the  following: 

1.  Find  a suitable  orbit  which  completes  its  cycles  (closes)  in  about  180  days.  The 
required  swath  width  is  about  25  km,  which  will  be  covered  with  7 1/2  meter  pixels. 

2.  Ad 3US t the  basic  orbit  selection  so  that  a wider  swath  will  close  in  2-3  months. 
Cover  this  wider  swath  saction  with  15-metar  pixels.  The  pixels  in  the  center 
narrow  section  may  be  averaged  to  form  the  center  part  of  the  wider  swath,  either 
on  board  or  on  the  ground.  Let  this  section  be  about  60-km  width. 

3.  Further  adjust  the  orbit  to  allow  a still  wider  swath  tc  cover  in  about  7 days.  The 
width  will  be  300-4^.0  km,  depending  on  the  revisit  time  desired.  For  8-dav  maximum 
intervals  (with  some  intervals  shorter),  the  required  width  is  about  400  km,  and  tor 
11- day  maximum,  the  width  is  about  300  km.  Cover  the  wide  swath  with  45-t0  meter 
pixels  (TBD) , and  suitably  average  the  pixels  in  the  center  sections  to  form  a con- 
tinuous wide  swath. 

4.  Be  sun-synchronous. 


Basic  Orbit  Coverage  Periodicity 

The  basic  requirement  for  periodic  coverage  is  that  the  nadir  trace  return  to  a previ- 
ously traversed  path  after  some  definite  period  of  time,  that  is,  the  Rth  orbit  trace  falls 
on  the  Nth  repetition  of  the  origin  (end  of  the  Nth  day).  This  is  equivalent  to  viewing 
the  equator  as  a continuous  arc  passing  under  the  ascending  node,  with  the  arc  measure  ac- 
cumulating indefinitely  instead  of  resetting  each  day.*  Note  that  N and  R are  both  inte- 
gers. 

The  N- f old  equatorial  arc  is  divided  in  two  ways;  into  N equal  parts  and  into  R equal 
parts.  The  smallest  division  mode  which  includes  both  of  these  is  equal  t?  RK  ii  R and  N 
arc  relatively  prime.  R and  N must  be  held  relatively  prime  to  avoid  redundant  repeating 
of  the  intended  closure  period. 

The  orbit  repetition  parameter  Q is  t..e  prime  descriptor  of  the  coveraqe  pattern.  C is 
defined  as  the  number  of  satellite  orbit  revolutions  completed  dunnq  a sinqle  rotation  of 
the  earth  relative  to  the  satellite  plane  (approximately  equ/.l  to  the  number  of  revolutions 
in  a day).  The  value  of  Q depends  primarily  on  the  orbit  period,  which  in  turn  depends  on 
the  satellite  altitude,  v}  is  normally  expressed  111  the  form 

0 « 1 ♦ K /N 

where  X is  the  number  of  complete  satellite  revolutions  and  K/N  is  the  additional  fraction 
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of  a satellite  orbit  required  for  a point  on  the  earth  to  complete  one  revolution  and  to 
reencounter  the  satellite  plane,  (Note  the  parallel  between  this  and  the  action  of  the 
vernier  scales  used  to  measure  the  fractional  distance  between  scale  marks,)  For  a reso- 
nant orbit  the  fraction  is  tero.  The  fraction  K/N  determines  the  swathing  pattern,  inde- 
pendent of  the  integer  part  of  Q,  which  determines  the  gross  scaling  of  the  orbit  advance 
per  orbit. 

The  design  space  available  is  generally  in  the  range  of  400-1300  km  altitude,  which 
results  in  a 0 range  of  13-15.  Within  this  range,  sun-synchronism  is  obtained  with  orbit 
inclinations  in  the  range  of  97-101  degrees  (see  Figure  2) . 


Figure  2.  Potential  Design  for 
Sun-Synchronous 
Satellites 


The  design  procedure  is  to  select  the  K/N  to  give  the  desired  pattern,  and  then  to 
select  I to  correspond  to  the  altitude  range  desired. 


The  6-month,  2-month  desire  for  semiannual  and  (approximately)  seasonal  repeat  requires 
that  K N be  approximately  1/3.  The  additional  requirement  that  there  be  not  precise  clo- 
sure until  about  a year  requires  that  K/N  be  displaced  from  1/3  by  a small  amount.  Because 
N is  the  number  of  days  for  closure,  R = NI  ♦ K . Because  R,  v,  and  I are  integers,  K must 
also  be  integer,  selected  so  that  R and  N are  relatively  prime. 

Thus,  choose  N * 185  for  the  6-month  period.  K must  be  about  185  '3  - 62,  approximately. 
Two  patterns,  with  K = 67  and  K * 69,  are  presented  in  Figures  3 and  4,  which  show  the  de- 
sired patterns  and  with  the  desired  closures  of  the  wide  swath  giving  repeat  times  of  11 
and  8 days,  respectively. 


TRALR  NO. 


Figure  3.  Low  Order  Coverage  Obtained  with  K/N  * 69/185  (left)  and  6 7/185  (right)  . 
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Selecting  I in  the  range  of  13-15  sets  the  altitudes; 

1 * 13  Altitude  * 1145  km  Inclination  « 100. 0 degrees 

14  767  98.5 

15  445  97.3 

The  Sensor 

The  semiannual  closure  time  chosen  results  in  the  basic  track  separation  interval  being 
about  15  km.  Thus,  the  center  section  should  be  about  20-25  km  wide  to  allow  for  orbit 
variations.  The  second  and  outer  sections  are  about  60  and  either  300  or  400  km,  respec- 
tively, to  provide  the  progressively  more  often  repeated  coverage  while  the  center  section 
gradually  covers  the  globe  once  (Figure  5) . 

If  all  of  the  sections  are  to  be  panchromatic  or  to  have  the  same  spectral  bands,  the 
inner  pixels  may  be  averaged  to  fill  in  the  outer  sections.  This  will  reduce  the  inter- 
sensor  differences  in  response  which  would  otherwise  be  present.  At  the  same  time,  however, 
the  center  pixels  will  be  useful  for  generatma  high  resolution  images,  for  precis -.on  loca- 
tion on  maps  of  the  entire  swath,  for  precision  location  of  boundaries  in  conjunction  with 
the  simultaneous  lower  resolution  pixels,  and  for  analysis  of  texture. 

The  spectral  requirements  may  be  met  using  a spectrum  spread  orthogonal  to  the  line  of 
spatial  pixel  locations.-  This  requires  an  area  sensor  array  the  long  dimension  for  the 
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SECTION  I 


20-25  km 
(7.5  m) 


SECTION  2 60  km  — 

(15  m) 

SECTION  3 300-400  km 

(45  OR  60  m) 


Figure  5.  Makeup  of  the  Multiple  Resolution  Swath  Sections 

pixels  along  the  swath  width,  and  the  short  dimension  (30  to  60  pixels  or  so)  to  sample  the 
spectrum  of  each  of  the  ground  instantaneous  fields  of  view.  This  approach  guarantees  spec- 
tral band  registration,  as  all  pixels  are  sampled  simultaneously. 

The  area  array  would  image  only  one  7.5  meter  pixel  line  at  a time.  The  various  reso- 
lutions and  spectral  selection  would  be  accomplished  with  logic  on  board  to  minimize  data 
bandwidth  requirements.  If,  for  example,  the  high  resolution  is  desired  panchromatically , 
the  inner  section  pixels  would  be  averaged  across  the  spectral  set,  but  not  spatially.  They 
may  also  be  averaged  spatially  to  match  the  spectral  and  spatial  characteristics  of  the 
other  sections.  Inter-detector  differences  are  reduced  in  both  cases,  mitigating  some  of 
the  deficiencies  of  the  small  pixel  detectors.  At  the  same  time,  the  on-board  processing 
provides  additional  flexibility  in  both  the  spatial  and  spectral  domains  by  allowing  com- 
mandable  changes. 

The  data  rate  may  be  kept  within  bounds  by  selecting  the  minimum  resolution  in  the  sec- 
tions to  satisfy  a givan  observation,  and  selecting  or  synthesizing  a small  number  of  re- 
quired spectral  bands  from  the  30  to  60  available.  The  specific  data  rate  resulting  will 
depend  upon  the  design  parameters  ultimately  chosen.  For  example:  Consider  section  1 
(20  km  width)  to  be  panchromatic  after  averaging  in  the  spectral  domain,  to  be  used  for  edge 
registration,  panchromatic  texture,  and  mapping.  Section  2 (60  km  width)  would  be  seven 
bands,  chosen  primarily  to  provide  four  bands  for  agriculture  plus  three  extra  bands  for 
geology  or  other  disciplines.  Section  3 (300  or  400  km  width)  would  be  just  • ,e  four  aqn- 
culture  bands.  With  resolutions  of  7.5,  15,  and  45  meters,  the  aggregate  dat  rate  with  8- 
bit  pixels  is  about  190  K bit/sec  before  data  compression.  Compression  in  the  range  of  5:1 
may  be  practical  without  appreciable  data  loss,  at  least  for  the  four-band  sections,  which 
would  reduce  the  net  data  rate  by  a factor  of  about  2:1  to  4:1.  The  data  rate  will  be  large, 
but  not  intractable. 

Potential  design  altitudes,  as  discussed  above,  are  767  or  445  km.  These,  and  the  de- 
sired swath  widths,  set  the  angular  field  required.  The  angular  extent  ^ of  a 7 . 5 meter 
pixel  at  these  altitudes  is  10  or  17  urad,  comfortably  above  the  diffraction  limit,  although 
it  will  push  the  excellence  of  the  optical  design.  Practical  detectors  currently  are  about 
40  urn  in  size,  with  some  hope  of  reducing  this  to  25  urn  or  so  in  the  future.  These  two 
sizes  set  the  required  focal  length  of  the  lens.  Finally,  a system  with  a speed  of  f:2  to 
f : 4 is  visualized,  which  sets  the  lens  diameter.  These  combinations  are  shown  in  Table  1. 


Swath  Field 

Width  Alt.  4 pixel  of  View 

km  km  km  deg. 

40  um  Detectors 

Line  Focal  f ; 2 

Length  Length  Dia. 

m mm 

25  um  Detectors 

Line  Focal  f ; 2 

Length  Length  Dia. 

m mm 

400  767  9’8  29 

445  16.9  48 

- 4.1  2.1 

1 2.4  1.2 

! 33  2‘6  l-3 

1.5  0.8 

767  «•«  22 

445  16.9  37 

4.1  2.1 

2.4  1.2 

1 0 2’6  3*3 

A-U  1.5  0.8 

Table  1.  Design  Parameters  for  40  um  and  25  um  Detectors  and  7.5  meter  pixels. 

The  requirement  for  wide  field  optics  for  the  300-400  km  section  is  a problem  if  high 
resolution  : s required  to  the  edge  of  the  swath.  However,  the  lower  resolution  postulated 
for  the  outer  sections  will  allow  the  optics  performance  to  be  relaxed  at  the  edge  of  the 
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field  of  view,  where  the  problem  is  normally  the  worst.  As  an  alternate,  the  wide  swath 
portion  may  be  met  with  a separate  sensor.  Thus,  section  1 and  2 may  be  met  with  a sensor 
covering  only  60  km  with  the  7.5  meter  pixels,  and  a separate  sensor  covering  the  wide  field 
45  meter  pixels.  Table  2 shows  this  combination.  This  approach  greatly  reduces  the  optics 
problem,  but  requires  that  the  two  sensors  be  accurately  boresighted.  The  two-sensor  de- 
sign has  a secondary  advantage:  at  the  expense  of  a higher  data  rate,  and  because  the  wide 

angle  section  optics  will  cover  the  complete  field  of  view  anyway,  this  section  could  be 
implemented  with  a complete  complement  of  45  m pixels.  Then,  as  it  is  redundant  to  the  de- 
tectors of  section  2#  that  section  could  be  programmed  for  different  spectral  bands  than 
used  in  section  3. 


40 

um  Detectors 

25 

um  Detectors 

Swath 

Field 

Line 

Focal 

f :2 

Line 

Focal 

f :2 

Width 

Alt. 

<?  pixel 

of  View 

Length 

Length 

Dia. 

Length 

Length 

Dia. 

km 

km 

km 

deg . 

m 

m 

m 

m 

m 

m 

400 

767 

58.8 

29 

0.75 

0.4 

0.22 

0.43 

0.22 

445 

101.4 

48 

u . * 

0.4 

0.2 

0.2S 

0.13 

300 

767 

48.8 

22 

n 9 

0.75 

0.4 

0.17 

0.43 

C .22 

445 

101.4 

37 

U . j 

0.4 

0.2 

0.25 

0.13 

60 

76  7 

9.8 

4.5 

4.1 

2.1 

2.6 

1.3 

445 

16.9 

7.7 

U • j 

2.4 

1.2 

V >4 

1.5 

0.8 

Table  2.  Design  Parameters  for  40  urn  and  25  um  Detectors,  with  45  m pixels  for  the 
300  or  400  km  section  and  7.5  m pixels  for  the  60  km  section. 

Conclusion 


A concept  for  a multiple  resolution  sensor  is  presented  which,  by  allowing  the  various 
driving  parameters  to  be  traded  off,  may  allow  satisfaction  of  several  disciplines  which 
are  otherwise  competing  for  coverage  and  spectral  and  spatial  resolution.  Although  some 
examples  of  possible  design  parameters  are  given,  this  is  not  meant  to  propose  any  specific 
design.  Rather,  they  are  given  as  food  for  thought.  However,  they  are  believed  to  be  rep- 
resentative of  the  designs  possible. 
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8.7  ATTITUDE  TRACKER 
Fred  C.  Billingsley 

Jet  Propulsion  Laboratory,  California  Institute  of  Technology 
Pasadena,  California  91109 


Line  array  sensors  produce  data  which  has  no  inherent  geometrical  continuity. 
Hence,  any  platform  attitude  variation  will  be  evidenced  as  a distortion  when 
the  data  lines  are  displayed  in  the  normal  Cartesian  raster.  Ancillary  sensing 
is  required  to  establish  the  platform  attitude  to  allow  geometric  rectification. 
This  is  normally  provided  by  inertial  or  star  reference  attitude  sensors. 

However,  in  the  absence  of  such  sensors  or  if  performance  of  them  is  degraded, 
the  required  attitude  information  is  lost. 

A strawman  sensor  design  is  proposed  which  utilizes  small  image  areas 
on  the  ground  to  provide  a series  of  motion  vectors  with  which  the  platform 
attitude  can  be  tracked;  this  allows  the  distorted  image  received  by  the  normal 
image  line  sensor  to  be  rectified. 


THE  PROBLEM 

Future  sensors  of  the  linear  array  type  will  return  lines  of  data  which 
are  independent  in  the  sense  that  there  is  no  data  tie  between  them.  It  is 
essential  for  mapping  and  stereo  work  that  the  data  lines  used  for  analysis 
be  in  precisely  the  correct  geometrical  position.  If  the  sensed  image  lines 
are  not  in  the  correct  positions,  interpolation  or  other  compensation  must 
be  used  before  analysis.  But  there  is  no  information  in  the  data  as  planned 
to  measure  the  correctness  of  position;  position  accuracy  depends  on  platform 
attitude  accuracy  for  a sufficiently  long  period.  Anticipated  spacecraft 
control  parameters  will  be  (marginally)  adequate  if  all  is  perfect,  but  there 
is  not  much  tolerance  for  degradation,  nor  any  planned  way  to  work  around 
degradations.  The  use  of  ground  control  points  will  be  necessary  for  precise 
tie  to  the  ground,  but  will  be  clumsy  for  continued  use  for  the  stereo  tracking, 
and,  in  any  event,  surveyed  ground  control  points  will  not  be  available  for 
many  areas.  The  problem  is  exacerbated  with  an  aircraft  platform  due  to  the 
ubiquitous  attitude  instability. 

WHAT  IS  NEEDED 

What  is  needed  is  a system  for  analyzing  the  platform  motion  as  reflected 
in  the  ground  distortions,  which  may  be  used  to  1)  verify  platform  stability 
and  2)  provide  the  data  for  correcting  the  geometric  aspects  of  the  image 
lines,  either  in  parallel  with  the  expected  good  performance  of  a spacecraft 
platform  or  to  compensate  for  degraded  performance.  Ideally,  the  system 
would  be  useful  on  board,  but  ground  calculations  and  correction  would  be 
acceptable.  Maximum  use  should  be  made  of  the  GCPs  and  the  Global  Positioning 
System,  but  the  system  should  allow  (perhaps  degraded)  use  without  these. 
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STRAWMAN  SOLUTION 


A system  for  providing  the  data  for  self-tracking  could  be  designed  as 
follows:  As  part  of  a separate  sensor  boresighted  to  the  imaging  sensor,  a 

set  of  small  square  image  areas  of,  say  64  x 64  or  128  x 128  pixels,  arranged 
as  sketched  (Figure  1)  is  imaged  on  to  a set  of  area  array  detectors.  All 
are  read  out  simultaneously  into  a set  of  memories.  For  each  area,  the  dis- 
placement between  it  and  a previous  image,  taken  a few  image  lines  previously 
is  determined.  The  sequential  set 
of  displacement  vectors  may  be  used 
to  model  the  platform  attitude  vari- 
ations, and  to  generate  the  geometric 
correction  parameters.  The  related 
software  will  have  to  bridge  gaps 
in  the  displacement  vector  sequence 
due  to  clouds  or  other  noncorrelation, 
and  to  operate  in  areas  of  terrain 
relief. 


Data  analysis  follows  the  well  known  stereo  compilation  principles.  The 
effects  as  seen  in  normal  stereo  compilation  practice  are  given  in  Figures 
2 and  3 (from  D.  H.  Alspaugh,  "Stereo  Compilation  and  Digitizing,"  Proc.  Latin 
American  Technology  Exchange  Week,  Panama  City,  May  1979,  p.  314). 
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Figure  3.  The  Image  Motion  Vector  Set 

as  it  Reflects  Platform  Motion 
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In  the  eventual  Instrument,  the  data  processing  would  be  self-contained 
(Figure  4),  so  that  only  the  derived  attitude  parameters  would  be  transmitted 
or  utilized. 


»—  Out 


ITT  to  Store 
Cole  Attitude 


Figure  4.  Data  Processing  Block  Diagram  and  Timing 

Lockheed^  & ^ has  built  a phase  plane  comparator,  including  the  FFT, 
which  operates  in  1/30  second.  Incorporation  of  this  approach  could  allow 
this  part  of  the  processing  to  be  time -multiplexed. 

1.  Kuglin,  C.  D. , hines,  D.  C.,  "The  Phase  Correlation  Image 
Alignment  Method,"  Proc.  IEEE  1975  International  Conference 
on  Cybernetics  and  Society,  pp.  163-165. 

2.  Pearson,  J.  J.,  Hines  D.  C. , Golosman,  S. , "Video  R*te 
Image  Correlation  Processor,"  SP IE  Vol . 119,  Applications 
of  Digital  Image  Processing,  IOCC  1977,  pp.  197-205. 

It  may  be  necessary  to  incorporate  a LIDAR  or  equivalent  sensoi  to 
determine  the  instantaneous  altitude. 
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8.8  A CASE  FOB  HHRHEIT  GEOMETRIC  AID  GEODETIC  ACCDKACT 
H REMOTELY  SEISED  TUB  AID  SHU  DUGUG  PBODOCTS* 

by 

Johnie  M.  Driver*1 


INTRODUCTION 

The  multispectral  images  produced  by  Landsats  1,  2,  and  3 have  pro- 
vided valuable  data  to  a diverse  spectrum  of  users  worldwide  and  there  is 
presently  a growing  demand  for  more  and  better  data  of  this  kind.  Techno- 
logies are  under  development  to  satisfy  this  growing  demand  — better 
detectors,  new  imaging  modes,  improved  platforms,  and  innovative  utiliza- 
tion techniques.  There  is  a compelling  legitimate  concern,  however,  that 
new  data  types  be  mergeable  with  existing  data  types.  To  satisfy  this 
concern,  there  is  a tendency  to  force  new  data  types  to  fit  existing  usage 
modes  with  an  unnecessary  efficiency  impairment  that  can  be  grossly  debili- 
tating with  an  increasingly  large  volume  of  data.  This  paper  argues  for 
image  acquisition  concepts  and  processing  methods  which  take  proper  advan- 
tage of  new  imaging  modes  and  accompanying  technologies.  The  goal  is  to 
provide  delivery  timeliness  and  throughput  efficiencies  commensurate  with 
the  volume  of  data  acquired. 

The  inherent  inaccuracies  in  the  previous  Landsat  scanning  imaging 
method  rendered  extensive  image  rectification  a necessity.  By  contrast, 
the  inherent  linearity  in  solid  state  line  array  imagers  shows  promise  for 
allowing  acquisition  of  images  with  inherent  geometrical  accuracy,  leaving 
platform  dynamics  as  the  principal  source  of  error.  But  new  platform 
developments  can  potentially  provide  acceptable  stability  and  pointing 
accuracy.  Hence  there  is  a real  prospect  for  acquiring  images  with  inhe- 
rent geometrical  accuracy  at  least  for  certain  regions.  Platform  pointing 
adequacy,  when  coupled  with  adequate  orbit  state  determination,  can  provide 
geodetic  accuracy  as  well.  Further  research  is  required  to  determine 
conditions  under  which  inherently  accurate  global  imagery  can  be  acquired 
both  geometrically  ar.d  geodetically,  and  how  such  imagery  can  be  processed 
to  provide  the  high  volume  throughput  demanded  ^and  the  required  data  mer- 
geability  as  well. 


•This  paper  presents  the  results  of  one  phase  of  research  carried  out  at 
the  Jet  Propulsion  Laboratory,  California  Institute  of  Technology,  under 
contract  NAS7-100,  sponsored  by  the  National  Aeronautics  and  Space  Admini- 
stration. 

••Member  of  the  Technical  Staff,  Mission  Design  Section,  JPL 
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IMAGING  OBJECTIVE 


The  long-range  imaging  objective  is  to  provide  information  adequate  to 
satisfy  the  perceived  operational  nisslon  needs.  Principal  needs  relate  to 
quality,  timeliness,  continuity,  coverage,  usage  diversity,  and  economy. 
These  needs  are  discussed  at  some  length  in  References  1 and  2 and  are 
summarized  in  Table  1.  This  paper  focuses  on  "Data  Processing  Efficiency" 
as  described  under  the  second  bullet  of  Table  1.  The  imaging  system 
assumed  is  one  which  satisfies  the  remaining  requirements  except  for  Ther- 
mal IR  and  Microwave  Imagery.  The  specific  Imaging  objective  as  relates  to 
this  analysis  is  to  acquire  Images  anywhere  on  the  globe  wnich  are  inher- 
ently accurate  both  geometrically  and  geodetically.  Acquisition  of  such 
images  will  enable  efficiencies  in  processing  with  consequent  relief  from 
timeliness  and  throughput  problems  that  have  plagued  Landsats  1,  2,  and  3» 

SCIENTIFIC  IMPORTANCE 

Geometrically  accurate  Images  are  essential  to  automatic  information 
extraction  as  well  as  extraction  of  bootstrap  information,  i.e.,  mission 
parameters  determination  from  image  data.  Qualitative  (i.e.,  photointer- 
pretative)  use  of  images,  although  forgiving,  is  enhanced  by  geometric 
accuracy  as  is  also  the  capability  for  quantitative  information  extraction 
in  a manual  mode.  Images  which  are  not  geometrically  correct  when  acquired 
(inherent \j  accurate)  must  be  corrected  by  various  time-consuming  rectifi- 
cation processes  (image  line  rotation,  translation,  stretching,  warping, 
etc.).  Obtaining  images  which  are  inherently  accurate  offers  the  following 
important  scientific  advantages: 

a)  Provides  timely  quick-look  information  for  reconnaissance  ana 

episodic  events  analysis. 

b)  Provides  the  potential  for  onboard  information  extraction. 

c)  Avoids  the  partial  loss  of  spatial  and  spectral  information  which 

resampling  typically  incurs. 

d)  Allows  timely  analysis  of  a large  volume  of  high-resolution  mul- 

tispectral  data  which  could  be  totally  intractable  using 

conventional  processing  techniques. 

Geodetic  accuracy  is  essential  for  such  processes  as  multi— temporal 
comparisons,  ground  control  point  improvement,  digital  mosaicking,  auto- 
matic inter— image  matching,  automatic  map  updating,  and  map  construction  to 
NMA  standards.  If  the  acquired  images  are  not  inherently  accurate  geodeti- 
cally, laborious  ground  control  point  fitting  must  be  employed  which  can  be 
costly  and  slow  Indeed  when  done  automatically  by  correlation  techniques, 
particularly  without  benefit  of  a good  a priori  estimated  location.  With 
adequate  knowledge  of  platform  orbit  state  and  instrument  pointing  direc- 
tion, data  can  be  acquired  with  inherent  geodetic  accuracy,  making  possible 
the  scientifically  important  uses  indicated  above  which  would  otherwise  be 
too  costly  to  consider  on  any  massive  scale. 
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TECHNICAL  FEASIBILITY 


The  technical  feasibility  cf  acquiring  inherently  accurate  ioages  is  exa- 
mined here  in  terms  of  a particular  mission  and  imaging  system  concept  and 
specific  functional  capabilities.  The  analysis  considers  error  characte- 
ristics (types,  sources,  and  magnitudes)  and  conceptual  compensation  modes. 
The  stravman  concepts  assumed  for  this  analysis  are  summarized  below  but 
are  described  in  greater  detail  in  References  1 and  2 . 

Hissign  Concept 

A land  remote  sensing  mission  is  assumed  using  a free  flyer  spacecraft 
launched  from'  WTR  into  a near-circular  sun-synchronous  orbit.  The 
spacecraft  is  assumed  to  fly  at  882-km  altitude,  orbiting  the  Earth  every 
103  min  in  a contiguous  swathing  coverage  pattern,  completing  a repeat 
coverage  cycle  in  52  days  after  729  orbital  periods.  Surface  spacing 
between  adjacent  ground  tracks  occur  one  day  apart,  separated  by  55  km  at 
the  equator  and  decreasing  separation  along  latitude  lines  as  the  cosine  of 
latitude.  The  99-deg  Inclination  required  for  sun-synchrori sni  allows 
orthographic  imaging  of  all  regions  of  the  Earth  below  81  deg  latitude. 

A pushbroom  imaging  concept  (Ref.  2)  is  used  (Fig.  1)  to  image  the 
land  masses  of  the  Earth  in  the  visible  and  near  infrared  (VNIR)  and  short 
wave  infrared  (SKIR)  spectral  ranges.  Each  image  line  is  formed  by  H000 
contiguous  detector  elements  arrayed  nominally  perpendicular  to  the  space- 
craft ground  track.  Image  exposure  time  is  adjusted  according  to  space- 
craft altitude  to  form  for  each  pixel  a square  Ground  Instantaneous  Field 
of  View  (G1F0V).  Area  array  detectors  are  used  to  allow  a dispersive 
imaging  approach,  enabling  selective  acquisition  of  multispectral  images 
from  any  portion  of  the  covered  spectral  range  with  high  spectral  resolu- 
tion and  inherent  spectral  registration. 

Simultaneous  utilization  of  three  types  of  imaging  devices  is  assumed 
to  provide  orthographic,  stereographic  and  arbitrary  site  oblique  imaging. 
Orthographic  imagery  is  provided  by  the  nadir-oriented  imaging  device. 
This  device  will  provide  a complete  and  repetitive  set  of  timely  and  synop- 
tic land  area  images  on  a near  global  scale.  This  multispectral  imaging 
device  will  emphasize  uninterrupted  coverage  with  high  geometric  and  geode- 
tic accuracy  suitable  for  cartographic  use. 

For  stereographic  imagery,  the  nadir-oriented  device  is  supplemented 
by  two  additional  instruments,  offset  fore  and  aft,  to  allow  continuous 
monospectral  imaging  of  the  terrain  from  three  different  vantage  points  ir. 
space.  Extremely  high  inherent  geometric  and  geodetic  accuracy  for  these 
stereographic  imagers  is  desirable  but  not  crucial.  This  is  due  to  the 
com. aratively  limited  data  volume  these  Instruments  produce  and  the  charac- 
teristically retrospective  and  selective  data  usage  mode  expected. 

The  third  imaging  device  is  multispectral  and  pointable  and  is  used 
intermittently  to  provide  timely  coverage  of  rapidly  changing  phenomena  at 
arbitrary  imaging  sites  anywhere  on  the  globe  (Ref.  2).  With  a capability 
of  pointing  55  deg  either  side  of  nadir  (Fig.  2),  the  instrument  will  be 
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capable  of  next-day  coverage  of  any  point  on  Earth  and  next-orbit  coverage 
at  high  latitudes.  Geometric  and  geodetic  accuracy  for  this  instrument, 
while  desirable,  is  not  crucial  — in  contrast  with  the  orthographic  imager 
— since  the  chief  information  use  depends  on  its  inherent  spectral  regis- 
tration instead. 

Specific  capabilities  for  these  three  imaging  devices  are  summarized 
in  Table  2.  Table  3 summarizes  the  expected  coverage  characteristics, 

£rr.or 

Typical  image  aberrations  include  scale  variations,  displacement, 
distortion,  skew,  and  rotation.  These  aberrations  are  common  to  all  imag- 
ing modes,  but  their  relative  importance  differs  from  one  mode  to  another. 
Intraframe,  interframe,  swa t u-to-sva th,  and  geodetic  registration  are 
affected  by  these  aberrations  to  varying  degrees.  The  following  material 
discusses  the  error  types,  principal  causes,  and  gross  magnitudes  for  each 
imaging  mode  and  examines  inherent  accuracy  feasibility. 

Orthographic  Imagery.  Table  lists  the  characteristic  image  aberra- 
tions expected  for  the  orthographic  imager  if  no  special  measures  are  taken 
to  obtain  inherent  accuracy.  The  table  shows  areas  where  research  is 
needed  to  find  acceptable  error  compensation  options. 

The  list  in  Table  4 is  dominated  by  intraframe  errors,  the  primary 
determiners  of  geometric  accuracy.  Image  scale  changes  of  typically 
occur  due  to  altitude  variations,  driven  by  the  combined  effects  of  gravity 
harmonics  and  Earth  flattening,  hindering  one-to-one  correspondence  of 
image  pixels  with  predetermined  geographic  locations.  These  same  altitude 
changes  coupled  with  velocity  variations  hinder  equilateral  pixel  dimen- 
sions on  the  ground  unless  compensated. 

Continual  platform  movement  around  the  pitch  axis  to  maintain  a nadir 
orientation  gives  rise  t.o  keystone  distortion  in  the  image,  causing  a shape 
like  the  central  portion  of  an  orange  slice.  This  distortion,  although 
worse  for  wider  swath  widths,  appears  entirely  negligible  for  a 60-km 
swath. 


Frame  skew  occurs  when  the  spacecraft  maintains  a fixed  inertial 
heading  while  imaging  the  rotating  Earth.  The  resultant  image  is  composed 
of  an  array  of  parallelogram-shaped  pixels,  skewing  the  frame.  This  aber- 
ration may  not  pose  any  serious  information  extraction  problem.  The  skew 
can  be  removed  by  continuous  yawing  of  the  spacecraft  as  a function  of 
latitude.  However,  this  yaw  rotates  the  image  lines  and  gives  rise  to  non- 
parallelism which  can  result  in  large  relative  pixel  displacements  at  the 
image  frame  edge. 

Earth  curvature  causes  image  lines  to  overlap  toward  the  frame  edges, 
particularly  for  wide  swaths.  The  less  than  It  overlap  expected  due  to 
Earth  curvature  should  not  significantly  impact  image  radicmetry  and  is 
probably  negligible.  Random  distortions  can  occur  within  an  image  frame 
because  of  drift,  vibration  or  Jitter  in  the  imaging  platform  or  instru- 
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Bent.  If  drift  rates  are  kept  to  10"-  deg/s,  no  serious  in age  impairment 
should  result.  However,  drift  rates  as  large  as  10”  deg/s  give  cause  for 
concern  and  would  doubtless  rule  out  obtaining  inherent  geometrical  accu- 
racy at  tLv.  15-m  pixel  level  except  for  small  swaths. 

Significant  interframe,  swath-to-swath  and  geodetic  errors  stem  prin- 
cipally from  navigation  errors,  altitude  variations,  and  attitude  control 
inaccuracies.  Errors  of  these  types  hinder  mosaicking,  multitemporal  com- 
parisons, and  map  registration.  With  accurate  models  and  suitable  ancil- 
lary data,  these  errors  and  those  above  can  be  compensated  if  necessary  by 
post— processing.  The  goal,  however,  is  to  obtain  inherent  accuracy.  Hence 
compensation  options  are  needed  onboard  the  spacecraft  so  that  the  received 
images  for  the  most  part  are  ready  for  use. 

Stereographic  Imagery.  The  principal  stereographic  image  aberrations 
relate  to  obtaining  interframe  registration  between  a given  pair  of  images 
from  the  triplet  obtained.  The  error  types,  causes  and  expected  magnitudes 
are  shown  in  Table  5.  The  scale  of  one  image  differs  from  the  other 
because  of  differential  variations  in  imaging  distance,  impairing  pixei-to- 
pixel  coincidence  between  frames.  Orbit  dynamics,  Earth  geometric  flatten- 
ing, and  attitude  control  errors,  principally  around  the  pitch  axis,  are 
the  major  contributors  to  stereographic  image  scale  errors.  Image  dis- 
placements hinder  inherent  frame-to-frame  correspondences.  Earth  rotation 
is  the  principal  contributor  giving  rise  to  a 27-km  loss  in  stereoframe 
overlap  if  not  compensated  (Fig.  3).  If  compensated  by  yawing  the  imaging 
platform,  ’ssuming  the  focal  planes  of  all  three  cameras  are  rigidly  fixed 
relative  to  the  platform,  image  line  rotation  occurs  (Fig.  il).  This  line 
rotation  results  in  non-parallel  image  lines  ( . 3 mrad  middle-to-offset, 
8.6  mrad  between  offset  cameras)  as  well  as  a 1.7-km  departure  from  geo- 
graphical coincidence.  In  addition,  attitude  control  errors  can  cause 
significant  Anterfraae  displacement  errors  unless  limited  by  a tighter 
stability  rate  requirement.  A more  detailed  analysis  of  stereographic 
image  aberrations  is  given  in  Ref.  3* 

Oblioue  Imagery.  All  of  the  generic  geometrical  imaging  error  types 
( irtraframe,  interframe,  swath-to-swath,  and  geodetic)  are  found  to  a 
significant  degree  in  the  oblique  imaging  mode,  particularly  for  large  off- 
nadir  viewing  angles  and  large  swath  widths.  Figure  5 indicates  how  the 
iaage  scale  changes  as  a function  of  off-nadir  viewing  angle,  assuming  a 
fixed  imager  field  of  view.  The  imaging  distance  variation  relates  direc- 
tly to  pixel  spread  alongtrack.  The  swath  width  variation  shows  the  com- 
bined effect s of  increasing  Imaging  distance  and  Earth  curvature. 

Figt  -a  6 shows  the  character  of  the  intraimage  distortion  caused  by 
off-nac  • viewirg  at  large  angles.  It  is  noted  that  for  sufficiently  small 
swath  portions  (10-30  km),  this  keystoning  effect  can  be  kept  to  pixel 
ler^l  across  the  frame  even  at  'arge  off-nadir  angles. 

wpatenaatlflfl  Options 

A atabl'  Imaging  platform  is  of  fundamental  importance  to  acquiring 
images  with  inherent  geometrical  accuracy.  Attitude  stability  in  the 
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vicinity  of  10"**  deg/s  is  needed  for  15-m  GIFOV  in  a 60-km  frame  size.  A 
larger  frame  size  at  the  same  resolution  implies  a pointing  stability  which 
is  proportionately  more  precise.  Given  inherent  geometrical  accuracy  with- 
in the  Image,  pointing  accuracy,  or  at  least  accurate  pointing  knowledge, 
becomes  the  next  sine  qua  non  for  geodetic  accuracy.  When  coupled  with  10* 
to  15-m  orbit  position  knowledge,  a O.OCI-deg  pointing  accuracy  will  enable 
geodetic  registration  to  within  one  15-m  pixel  most  of  the  time. 

Beyond  the  basic  platform  requirements,  many  mission  parameters  impact 
the  attainable  accuracy  as  discussed  in  the  previous  section.  Figure  7 
suggests  compensation  options  for  some  of  the  potential  image  aberrations 
encountered.  Thje  principal  cause  of  orthographic  image  aberration  is  the 
image  scale  and  pixel  shape  errors  caused  by  orbit  altitude  variations. 
Methods  and  options  for  orbit  altitude  control  should  be  investigated 
thoroughly  to  assess  the  potential  for  error  ninimization.  Successful 
orbit  control,  whether  through  orientation  and  shaping,  restricted  region 
operation,  or  active  propulsion,  will  benefit  all  imaging  modes.  Typical 
orbit  characteristics  and  expected  deviations  are  explored  in  Ref.  4-6. 

In  principle,  certain  instrument  design  features  can  be  used  to  com- 
pensate for  potential  image  aberrations.  If  a practical  method  is  found 
for  dynamic  focal  length  variation,  image  scale  problems  could  be  essen- 
tially overcome  for  all  imaging  modes.  Altitude  variations  could  be  tole- 
rated for  orthographic  imagery,  geometrical  flattening  and  orbit  dynamics 
could  be  compensated  for  stereographic  imagery,  and  the  effects  of  imaging 
distance  variations  for  arbitrary  site  imaging  could  be  ameliorated.  If 
focal  plane  rotation  is  feasible,  image  line  rotation  in  stereographic  and 
orthographic  imagery  need  no  longer  be  a problem.  The  capability  for 
dynamic  variation  of  image  line  exposure  time  could  be  a very  valuable 
instrument  design  feature.  This  feature  would  allow  maintenance  of  square 
pixels  with  consequently  greater  image  regularity  and  scalability  even  if 
the  overall  image  scale  changed  with  altitude.  Without  variable  exposure 
time,  instrument  electronics  redesign  would  be  required  to  obtain  square 
pixels  and  variable  resolution  at  different  nominal  operating  altitudes. 

Given  sufficiently  accurate  ancillary  data,  compensation  for  various 
image  aberrations  could  be  performed  onboard  the  spacecraft.  Processes 
such  as  geometrical  correction,  dynamic  scaling,  resampling  to  a map  grid 
and  registration  to  star  references  are  conceivable  and  could  enable  inher- 
ent geometric  and  geodetic  accuracy  in  images  transmitted  to  the  ground. 

If  inherent  accuracy  is  not  achieved  through  the  various  processes 
discussed  above,  precise  orbit  and  attitude  knowledge  can  still  be  trans- 
mitted to  the  ground  where  various  high-powered  but  costly  and  slow  methods 
can  be  used  to  compensate  for  remaining  image  aberrations. 

I£CHNQLQfiI  BEAPIttESS 

The  continual  progress  being  made  in  pertinent  technology  developments 
heightens  the  promise  and  value  of  obtaining  inherent  geometrical  and 
geodetic  imaging  accuracy.  The  principal  technology  is  the  solid  state 
Imager  developments  which  make  possible  the  acquisition  of  high  resolution 
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images  with  high  slgnal-to-noise  content  and  with  inherent  spatial  linear- 
ity in  a roany-element  line  array.  The  extensions  being  made  to  allow  area 
arrays  make  possible  inherent  spectral  registration.  Obtaining  adequate 
geometrical  accuracy  onboard  offers  the  hope  for  optional  onboard  informa- 
tion extraction  with  consequent  transmission  of  only  the  extracted  informa- 
tion to  the  ground. 

Pointing  platform  technology  is  indicated  by  the  fraction  of  an  arc 
second  stability  and  accuracy  (Ref.  7)  promised  for  the  Annular  Suspension 
and  Pointing  System  (ASPS).  While  these  devices  are  slanted  primarily 
toward  inertial  pointing  needs,  extension  to  a nadir-oriented  device  with 
up  to  an  order-of- magnitude  degradation  would  satisfy  the  principal  inhe- 
rent accuracy  nteeds  envisioned  here.  The  Multimission  Modular  Spacecraft 
(MMS),  which  is  inherently  geared  to  Earth  observation  needs  (Ref.  8),  also 
shows  promise  for  providing  the  t0“*  deg/s  stability  needed  for  inherent 
geometric  accuracy. 

Orbit  position  knowledge  to  10  m is  targeted  for  the  Global  Position- 
ing System  (GPS).  This  accuracy  is  commensurate  with  pixel  level  geodetic 
accuracy  at  15-m  GIFOV.  Long-term  orbit  propagation  to  commensurate  accu- 
racies is  potentially  attainable  using  precision  propagators  such  as  GSFC's 
GEODYN  Program  (Ref.  9).  The  repeating  nature  of  typical  Earth  observation 
orbits  should  allow  construction  and  refinement  of  specialized  geopotential 
models  suitable  for  orbit  prediction  to  very  high  accuracies,  particularly 
with  refinement  of  atmospheric  drag  parameters  and  continual  updates  of  the 
modeled  atmosphere. 

Active  orbit  control  using  CMS  propulsion  on  Shuttle  missions  is 
probably  a viable  option  for  short-term  image  compensation.  Active  orbit 
control  using  onboard  propulsion  13  not  obviously  practical  for  free 
flyers.  The  potential  for  using  such  an  orbit  control  mode  should  be 
determined. 

Continual  Improvements  in  computing  speed,  memory,  and  size  minimiza- 
tion increases  the  options  for  onboard  computation.  Imaginative  utiliza- 
tion of  this  capability  can  also  be  a strong  factor  in  the  acquisition  of 
inherently  accurate  images. 

Overall,  the  technology  readiness  is  such  that  attaining  inherent 
geometric  and  geodetic  accuracy  in  the  acquired  images  is  a real  possibil- 
ity and  the  necessary  research  and  analysis  to  define  more  clearly  the 
options  and  requirements  is  warranted. 

RESEARCH  NEEDS 


GEODYN  UpiaUtf 

The  GEODYN  orbit  propagator  should  be  modified  to  compute  nadir  orien- 
tation and  orbital  position  relative  to  a triaxial  ellipsoid  rather  than  an 
oblate  spheroid  for  improved  geodetic  accuracy. 
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Continuing  research  in  atmosphere  modeling  is  needed  to  predict  aore 
accurately  the  short-term  variations  in  drag-related  parameters.  The  capa- 
bility to  allow  frequent  updates  to  the  ataosphere  aodel  is  warranted. 
Drag  will  constitute  the  major  orbit  prediction  uncertainty  for  typical 
low-  altitude  Earth  observation  missions. 

Geonotentlal  hcdfil  Development 

Procedures  need  to  be  developed  for  creating  in  routine  fashion  spe- 
cialized geopotential  models  which  take  advantage  of  the  repetitive  nature 
of  typical  Earth  observation  orbits  to  improve  prediction  accuracy.  Thus 
if  an  orbit  is  modified  to  provide  a different  coverage  pattern,  a new 
geopotent.al  aodel  of  comparable  accuracy  will  shortly  ensue. 

laasinfl  £U?Iccfl 

Research  is  needed  to  assure  that  for  both  free  flyer  and  Shuttle  or 
Space  Platform  missions,  the  capability  will  exist  to  provide  a 10”'  deg/s 
or  better  platform  stability  and  pointing  control  accuracy  or  knowledge  as 
a minimum  to  0.001  deg  for  a nadir-oriented  imaging  platform. 

Orbit  Dynamics 

Methods  of  control  for  orbit  dynamics  are  needed  to  define  the 
requirements  and  limitations  on  frozen  orbits,  constant  altitude  orbits, 
minimum  altitude  variation  orbits,  coverage  pattern  maintenance,  and  active 
orbit  shaping  using  onboard  propulsion. 

Geometrical  .Characlerlallc-g 

A detailed  investigation  is  needed  to  determine  the  precise  geometri- 
cal characteristics  of  acquired  images  on  a representative  Earth  surface 
for  accurately  modeled  orbits,  showing  geographical  dependence  and  the 
effects  of  typical  off-nominal  mission  characteristics. 

Variable  Ina  triune  at  Parameter  Development 

There  is  a potentially  high  payoff  in  acquired  image  quality  if  dyna- 
mic variation  of  instrument  parameters  can  be  implemented  in  a practical 
way.  Significant  research  is  warranted  to  find  a reliable  mechanization 
for  variable  focal  length  for  imaging  distance  compensation  on  spaceborne 
telescope-type  instruments  of  the  kind  envisioned  for  Earth  observation 
missions.  Similarly,  a mechanism  is  needed  to  provide  commanded  focal 
plane  rotation  one  cycle  each  orbit  for  thousands  of  orbital  revolutions. 
This  mechanism  would  be  used  to  maintain  image  line  parallelism  in  image 
frames. 

Dynamic  variation  of  image  line  exposure  time  is  simple  to  implement 
in  principle.  However,  there  are  doubtless  unforeseen  implications  in  the 
resulting  variation  of  data  acquisition  rates  and  possibly  some  image 
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radiometry  implications  as  well.  Research  is  needed  to  find  an  acceptable 
implementation  scheme,  thus  allowing  free  variation  in  orbit  altitude  and 
image  resolution  without  distortion  in  pixel  shapes. 

CONCLUSIONS 

It  has  been  shown  that  significant  aberrations  can  occur  in  acquired  images 
which,  unless  compensated  on  board  the  spacecraft,  can  seriously  impair 
throughput  and  timeliness  for  typical  Earth  observation  missions.  Concep- 
tual compensations  options  were  advanced  to  enable  acquisition  of  images 
with  inherent  geometric  and  geodetic  accuracy.  Research  needs  were  identi- 
fied which,  whe)'  implemented,  will  provide  inherently  accurate  Images. 
Agressive  pursuit  of  these  research  needs  is  recommended. 
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Table  1.  Perceived  Operational  Mission  Needs 


• DATA  CONTINUITY 

- CONTINUOUS  DATA  ACQUISITION 

- n""  disruptive  data  type  changes 

• DATA  PROCESSING  EFFICIENCY 

- OUAIITY  (PIXEL-LfVEl  PRECISION! 

- TIMELINESS  •OUICK-IOOK,  THROUGHPUT) 

- PRODUCTION  FACILITY  i INFORMATION 

EXTRACTION.  DISPLAY) 

- ECONOMY  (PURCHASE  PROCESSING! 

• OPTI.MAl  COYiRAGEJTRATEGY 

- MULTIPLE  ASPECT  VIEWING 

- ORTHOGRAPHIC  l NEAR-GLOBAL. 

- STEROSCOPIC  I CONTINUOUS 

- OBLIQUE  iMESOSCALE. 

INTERMITTENT! 

- CLOUD  FREE  SYNOPTIC  GLOBAL 

- RAPID.  SEASONAL.  AND  ANNUAL 

REPEAT  COVERAGE 

- optimal  lighting 

- CONTIGUOUS  SEQUENTIAL  SWATHS 


• TASKING  CAPABILITY 

- MISSED  SCENE  RECOVERY 

- SELECTED  AREA  IMAGING 

- SELfCTABLE  IMAGING  OPTIONS 

HFOV  SWATH.  BANDS. 

BANDWIDTHS) 

- OPTIONAL  THEME  SELECTION 

• IMPROVED  IMAGING  PARAMETER^ 

- SPATIAL  RESOLUTION  MO  TO  30  m IFOV) 

- SPECTRAL  RESOLUTION  OX  * 20  nmi 

- RADIOMETRIC  SENSITIVITY 

(NE^p  * 0.5T,) 

- ADDITIONAL  SPECTRAL  BANDS 

(15  OR  MORE! 

• NEW  TECHNICAL  CAPABILITIES 

- SHORT  WAVE  INFRARED  ■ SLYIRl 

- THERMAL  INFRARED  MIR! 

- MICROWAVE  IMAGERY 


Table 


2.  Instrument  Capabilities 

ORTHOGRAPHIC 

_&  OBLIQUE STlREOGRAPmC 


SPECTRAL  BANDS  (A  Cl 

SELECTABLE  BANDS 
BANDWIDTHS  (AM 

SPECTRAL  REGISTRATION 

SWATH  WIDTH  (SWi 

INSTANTANEOUS  FIELD 
OF  VIEW  (IFOV) 

TASKABLE  PARAMETERS 


30  CONTIGUOUS  IN  VNIR 
30  CONTIGUOUS  IN  SWI R 

ANY  6 OF  60  AVAILABLE 

20  TO  1?0  nm  IN  VNIR 
30  TO  120  nm  INSWIR 

INHERENTLY  PRECISE 
(DISPERSIVE  IMAGING) 

60  km  MAX.,  SELECTABLE 

15.  30.  45  OR  90  m 


SW.  IFOV.  XC. 

IMAGE  SITE  FOR  OBLIQUE 


SINGLE  BAND  BETWEEN 
0.8  AND  1.0pm 

NONE 

100  nm 

N.A 

50  TO  60  km  FIXED 
15  m 

B/H,  IFOV  mix 
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.Table  3.  Coverage  Characteristics 


INSTRUMENT 

ORIENTATION 

COVE  RACE 
EMPHASIS 

COVERAGE 

EXTENT 

COVERAGE 

CONTINUITY 

REPEAT  COVERAGE 
FREQUENCY 

ADJACENT  SWATH 
COVERAGE 

SPECIAL  FEATURES 


Error  Types 
Image  Scale 
Pixel  Shope 
Keystone  Distortion 

Frame  Skew 

Image  Line  Rotation 

Image  Line  Overlap 

Random  Distortion 


Orbit  State 

Image  Scale 

Displacement 

Rotation 


ORTHOGRAPHIC  STEREOGRAPHIC 

NADIR  ORIENTED  2V  FORE  AND  AFT 

CARTOGRAPHY  TOPOGRAPHY 


--  NEAR  GLOBAL  -- 


OBLIQUE 

POINTABli  *5 S' 
(CROSSTRACtO 

AGRICULTURE  AND 
EPISODICEVCNTS 

GLOBAL  SAMPLING 


--  CONTINUOUS  OVERLAND  -- 
DURING  DAYLIGHT  HOURS 

--  50  TO  60  DAYS  -- 


--NEXT  DAY  - 


INTERMITTENT 


NEXT  DA>  ANYWHERE 
NEXT  ORBIT  AT  HIGH 
LATITUDES 

ANY  SITE  ON  ANY  DAY 


UNINTERRUPTED  NEAR-GLOBAL  STEREO  • RAPID  REPEAT  COVERAGE 

COVERAGE,  LIMITED  DUAL  BASE-TO-HEIGHT  • UNLIMITED  TASKING 

TASKING  • FREQUENT  SITE  CHANGES 


TABLE  JL.  flKIHOCRAmC  IMAGE  ABERRATIONS 

Principal  Cauae 
TNTRAFRAME 

Variable  Altitude  v/ftxed  focal  length 


Expect  ei! 
Magnitudes 

2.A1 


Variable  Altitude  v/flxed  exposure  time 
Nadir  Orientation  on  Spherical  Earth 

Earth  Rotation  v/flxed  S/C  beading 
Fraae  Skew  Resoval  by  Spacecraft  Taw 


2.  AS 

1 b f SVi  6 1 km 
19  a 8 SVr 185  km 

A deg 

21  b 8 SV  = 6 1 lan 
167  a 8 SW:185  tat 


Earth  Curvature 


Platform  Stability 


0.07S  8 SW:61  kn 
0.61  8 SVrlBS  ka 

'5  B 6 10  " deg's, for  SWrfl  k» 
AS  b 8 10*"  deg/s  for  SN::185  kn 


INTERFRAME,  SNATH-TO-SVATH,  AND  GEODETIC 
Tracking  Capability 

Altitude  Variation 
Attitude  Control 
Attitude  Control 
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10  a CPS 
150  a TDRSS 

1.71 

15A  b 8 0.01  deg 

11  i f 0.01  deg  for  Skr61  k* 
32  a 8 0.01  deg  for  SWrl85  km 


TABLE  STERiQGt'PHlC  1M&  HtTERFBAHE  ABEBRATIOHS 


Error  Trp.a 


tclttlttfcl  Cause 


Expected 

MuaUmte 


liige  Scale 


Orbit  Dynamics 


900  ■ § SU* 61  ka 
1700  a # SV.1B5  kx 


Earth  Flattening 


180  a 8 SW*6i  k* 
550  a < SWt 185  ka 


Attitude  Control 


20  a f .01  deg  for  CV*6l  ka 
60  a i .01  deg  for  3V*185  k* 


Inage  Diaplaceaen 


Earth  Rotation 


27/55  ka 


Attitude  Control  (0.01  deg) 

Yaw  69/138  a 

Pitch  385  ka 

Roll  156  ka 

lav  Mechanization  v/flxed  cameras  1.7  ka 

Image  Line  Rotation  Yaw  Mechanization  w/fixed  cameras  4. 3/8.6  ««rad 


SPACECRAFT 

VELOCITY 


Fig.  1.  Pushbroom  Imaging  Concept 
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IS 


SATELLITE 

POINTABLE  IMAGER 
COVERAGE  REGION 

IMAGING  ANGLE  = 55° 


EARTH'S 

SURFACE 


ORTHOGRAPHIC  IMAGER 
COVERAGE  REGION 


Fig.  2.  Pointable  Imager  Coverage 


satellite  imaging  position  vs  time 


STEREO  TRIPLET  WITHOUT  REQUIRED  CAMERA 

CAM; -A  PLATFORM  YAW  PLATFORM  YAW 


Fig.  3.  Earth  Motion  Impact  on  Stereographic  Imagery 
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8L0 


U = B5° 

TULL  FRAME  61.4  * 61.4km 


79.0  1 

132.0 


LONKVTUDE 


139.0 


Fig.  4.  Stereographic  Image  Compensated  for  Earth  Motion  by  Platform  Yaw 


Fig.  5-  Ima  ge  Scale  Dependence  on  Off-Nadir  Viewing  Angle  With 
Fixed  Imager  Field  of  View 
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RESTRICTED, 
REGION  ! 
OPERATION  \ 


DYNAMIC 

SCALING 


Fig.  6-  Keystone  Distortion  Due  to  Cff-Nadir 
Inaging  on  a Spherical  Earth 


SELECTIVE 

ORIENTATION 

SHAPING 


EXPOSURE 

TIME 

VARIATION 


\ 


ORBIT  \ FROZEN 
CONTROL  1 ORBIT 


DYNAMIC  / INSTRUMENT  \FOCAL 

reorientation1compensat,0^^L. 

' /ROTATION 


ACTIVE 

PROPULSION 


GEOMETRIC 

CORRECTION 


CONCEPTUAL 

COMPENSATION 

OPTIONS 


FOCAL  LENGTH 
VARIATION 


SELECTIVE 

BYPASSING 


ONBOARD  \ STAR 
PROCESSING  j REFERENCE 
v j REGISTRATION 

V / 


7 \ 

PARAMETER  / GROUND  \ CONTROL 
EXTRACTION  ! PROCESSING  I P0INT 

LD.Tii  imrr  \ / rinim 


FROM  'MAGE 


FiniNG 


RESAMPLE  TO 
MAP  GRID 


\LL  REQUIRE 

PRECoiON  ORBIT  KNOWLEDGE 


DEFINITIVE  ORBIT 
DETERMINATION 


Fig*  7.  Options  for  Compensating  Orbit  Dynamics 
Impact  on  Image  Geometry 
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ABSTRACT 

Strips  of  ground  control  can  be  established  with  current  and  future 
satellite  sensory.  These  can  provide  precise  and  reliable  geometric 
references  for  locating  and  correcting  satellite  image  data  and  to  support 
temporal  image  registration.  This  paper  briefly  describes  the  concept  and 
approach  for  implementing  this  data  base  called  a Ground  Control  Strip, 
and  recommends  additional  work.  The  advent  of  new  solid  state  imaging 
systems,  xa  particular  the  linear  array  detectors  (pushbroom  sensors), 
make  this  new  concept  particulary  attractive  and  practical. 


INTRODUCTION 

Image  data  suffers  from  seme  degree  of  geometric  error.  The  error  sources 
are  due  to  sensor  characteristics  and  imperfections,  to  satellite 
attitude  perturbations,  and  to  orbit  decay  and  eccentricity  effects.  The 
external  geometry  of  a satellite  can  be  determined  from  star  trackers, 
horizon  sensors  and  gyro-compasses , inertial  platforms,  and  ground 
reference  or  control  points.  Geometric  errors  are  currently  precisely 
determined  and  corrected  by  the  use  of  ground  control  points,  which  are 
typically  32x32  pixel  subimages  used  to  establish  image  geometric  errors 
(Bernstein,  1975,1976,  and  Niblack,  1981). 

A ground  control  point  is  a subimage  which  includes  natural  or  cultural 
features  used  to  establish  a ground  reference  point  to  support  image 
correction  and  registrat ion . These  features  are  selected  to  have  the 
characteristics  that  they  can  be  precisely  located  in  the  image  and  on  the 
maps.  Digital  ground  control  points  have  been  used  for  about  a decade. 
These  have  replaced  "film  chip"  ground  control  points  commonly  used  in 
electo-opt ical  image  processing  systems.  Given  a sufficient  number  of 
ground  control  points,  a scene  can  be  corrected  to  sub-pixel  image 
accuracy  (see  Fig.  1).  It  is  apparent  from  Figure  1 that  many  GCP’s,  high 
resolution  data,  and  sub-pixel  registration  algorithms  are  needed  to 
obtain  high  image  geometry  accuracy. 

The  problem  with  using  conventional  ground  control  points  is  that  the 
features  are  initially  selected  and  stored  manually,  and  periodically 
manually  updated.  This  operation  is  t ime -consuming,  expensive,  and  error 
prone.  In  addition,  features  that  are  commonly  selected  are  those 
preferred  by  the  human  eye,  and  not  necessarily  those  that  are  best  for 
machine  registration. 


Paper  Presented  at  the  NASA  Registration  and  Rectification  Workshop, 
Leesburg,  VA. , Nov.  17-19,  1931. 
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Linear  array  sensors  have  been  proposed  to  support  earth  observation 
applications  (Welch,  1971,  Thompson,  1979,  Tracy  and  Noll, 1979,  Wight, 
1979,  Colovocoresses , 1979).  This  note  dicusses  how  these  sensors  can 
implement  a new  approach  to  establishing  a world-wiae  network  ground 
control  called  a Ground  Control  Strip  (GCS). 


MOTIVATION  FOR  NEW  APPROACH 

Motivating  factors  for  a new  approach  to  ground  control  were  identified  at 
the  NASA  Registeration  and  Rectification  Workshop  and  are  summarized: 

Higher  Resolution  Ground  Control  Data  - Users  and  analysts  have 
determined  that  the  accuracy  of  establishing  ground  control  is  closely 
related  to  the  resolution  of  the  source  data.  Thus  it  is  advantageous  to 
obtain  and  use  higher  resolution  data  for  establishing  ground  control. 

Higher  Accuracy  Source  Dat;*  - Due  to  spacecraft  structure  bending  and 
vibration,  even  star  trackers  will  not  provide  sufficiently  accurate 
external  orientation  data  without  additional  information  such  as  angular 
displacement  sensor  data.  The  use  of  sensor  coupled  data  has  the  advantage 
of  direct  and  close  coupling  of  the  data  used  for  image  correction  with 
the  data  to  be  corrected.  There  are  no  static  or  dynamic  errors  associated 
with  using  coupled  image  data. 

More  Ground  Control  Data  - Users  have  indicated  that  more  ground  control 
data  is  needed,  and  should  be  made  available  to  the  user  community.  This 
approach  directly  constructs  a large  geometry  control  data  base  daring 
mission  operation. 

Compatible  Sensor  and  Ground  System  - The  sensor  and  the  ground  system 
should  be  designed  as  an  integrated  system.  With  this  approach,  the  sensor 
system  is  designed  in  order  to  improve  ground  processing  operation 
efficiency  ana  image  accuracy,  which  may  reduce  mission  system  costs. 

CONCEPT 

This  concept  deals  with  the  development  and  use  of  a continuous  strip  of 
ground  control  used  to  determine  the  sensor  orientation  relative  to  the 
earth.  Assume  a linear  ar.ay  sensor  system  with  differing  resolution 
elements  such  as  that  shown  in  Figure  2.  The  detector  arrays  consist  of 
variable  s:ue  detectors*  with  higher  resolution  data  in  the  center  of  the 
image  swath.  While  the  sensor  is  on*  the  detectors  "sweeps11  the  earth  in 
the  direction  of  the  satellite  track,  providing  a contiguous  strip  of 
higher  resolution  data  ;eg.  , 7.5  m)  used  for  the  GCS.  The  higher 
resolution  data  can  bo  combined  to  provide  normal  linear  array  data.  Over 
a period  of  time,  strips  cf  data  are  acquired  that  are  wrapped  around  the 
earth  and  covers  the  earth  in  the  vicinity  of  the  subsatollite  point.  This 
strip  of  data*  after  editing  ami  ground  location,  can  than  serve  us  the 
geometric  reference  lor  subsequent  image  location,  correction,  and 
registration.  Clearly,  the  acquired  data  must  be  initially  ground 
located,  mosaicked,  and  edited. 
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It  is  apparent  that  satellite  roll  and  pitc*  can  be  accurately  determined 
wit^i  the  GCS  approach.  To  determine  yaw  accurately,  it  may  be  necessary  to 
use  an  "out-rigger11  network  of  ground  control  data.  This  question  will 
involve  a complete  error  analysis  with  a particular  set  of  conditions. 


SIZE  OF  DATA  BASE 

A preliminary  analysis  of  the  data  base  indicates  that  the  ground  control 
strip  concept  is  practical  from  the  point  of  view  of  the  data  storage 
requirements . 

For  the  Landsat-D  satellite  russion,  the  following  orbital  parameters 
apply  (NASA,  1981); 

Repeat  Period:  16  days 

O^uits/Repeat  Period:  233 

Ir ace  Spacing:  172  km 

The  cross-track  orbital  drift  will  be  approximately  455  ra  RSS  (1-sigma). 
This  corresponds  to  about  25  Landsat-D  pixels  drift  90,  of  the  time.  If 
one  assumes  a ground  control  region  four  times  wider  or  a 1S20  ro  wide 
strip  encircling  the  globe  used  for  ground  control,  and  a 7.5  m resolution 
ground  control  data  base,  and  further  since  the  oceans  cover  about  75%  of 
the  earth,  than  the  total  ground  control  strip  data  base  would  be: 


455x4  m x 233  orbits  x 40x10°  m/orbit 

Data  Base  = ■■■■■■ x C.25 

7.5  m/pixel  x 7.5  m/pixel 

=•  7.5-4  x 10^  pixels 

Thus,  the  Ground  Control  Strip  data  base  requirement  is  within  the 
capacity  of  current  mass  memory  systems,  and  a full  earth  data  base  could 
easily  fit  within  ten  high  density  tapes. 


TIME  TO  ACCUMULATE  DATA  BASE 

The  orbit  repeat  period  for  the  Landsat-D  mission  is  lo  days.  Due  to 
cloud  cover,  and  the  possible  need  for  data  over  differing  seasons,  the 
time  to  accumulate  the  GCS  data  base  would  become  larger.  Assuming  that 
50%  of  the  time  cloud  cover  can  exist  in  a particular  area,  there  would 
statistically  be  a minimum  time  of  seven  lb-day  periods  or  112  days  in 
order  to  have  99%  of  the  area  covered.  There  are  certain  areas  over  the 
earth  where  the  persistence  of  cloud  cover  may  require  up  to  several  years 
prior  to  cloud  free  acquisition. 
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ADVANTAGES  OF  APPROACH 


There  are  a number  of  advantages  of  this  approach: 

t1 

Automatic  Collection  of  Reference  Data  - The  strip  of  ground  control  is 
automatically  collected  and  stored*  This  minimizes  the  need  for  manual 
ground  control  selection. 

High  Resolution  Control  Data  - The  use  of  high  resolution  data  in  the 
region  of  ground  control  provides  the  needed  resolution  to  support  precise 
external  geometry  determination  and  image  correction. 

High  Density  Ground  Control  - The  contiguous  data  provides  a dense  data 
set  for  image  location,  correction,  and  registration.  This  dense  network 
is  an  improvement  over  the  relatively  sparse  network  of  ground  control 
currently  in  existence  and  allows  for  automated  alternative  area 
selection. 

Decreased  Sensitivity  to  Cloud  Cover  - The  continuous  and  extended  data 
set  available  with  this  approach  should  result  in  a lower  sensitivity  to 
cloud  cover.  When  cloud  cover  occurs  and  is  detected,  alternate  nearby 
cloud-free  ground  control  data  can  be  selected  and  used  to  establish  the 
geometic  parameters.  In  fact,  the  continuous  nature  of  the  data  coupled 
with  the  stability  of  new  satellite,  such  as  the  Landsat-D  (0.01  degrees 

and  1C  ° degrees/sec)  should  allow  for  long  segment  and  perhaps  orbital 
geometric  models  and  correction  parameters  to  be  determined. 

Multi-Mission  Capability  - The  Ground  Control  Strip,  having  high 
resolution  characteristics,  should  be  useable  for  other  missions  with 
sensors  of  similar  spectral  characteristics. 


FUTURE  WORK 

The  following  needs  to  be  done  to  adequately  assess  the  value  of  this 
approach: 

Error  Analysis  - An  error  analyis  of  the  approach  needs  to  be  performed, 
assuming  a set  of  satellite  attitude  and  orbit  character  it ics  and  sensor 
parameters.  The  Landsat-D  attitude  control  system  characteristics,  and  a 
variable  set  of  sensor  resolution  paramet*  ;s  should  be  used  to  predict  the 
resultant  image  geometric  characteristics.  A statistical  analysis  of 
cloud  cover  would  be  necessary  in  order  to  determine  the  available  amount 
cf  ground  control. 

Data  Management  Analysis  - A detailed  analysis  of  the  data  acquisition, 
selection,  editing,  storage,  and  retrieval  cf  the  data  needs  to  be 
considered.  Since  this  concept  involves  the  use  of  a larger  data  set  than 
previously  considered,  this  analysis  is  particularly  important. 

Cost  Analysis  - A study  to  assess  the  cost  of  this  approach  needs  to  be 
considered.  The  cost  savings  resulting  from  the  automation  of  the 
compilation  of  ground  reference  data  may  be  partially  offset  by  the 
increased  cost  associated  with  data  storage,  processsing  and  management. 
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CONCLUSIONS 


A concept  has  been  proposed  that  may  improve  the  correction  of  remotely 
sensed  image  data  from  satellites.  This  approach  may  reduce  the  time  and 
costs  associated  with  building  a ground  control  point  library  system,  and 
would  result  in  a larger  and  higher  resolution  data  base  to  support  image 
preprocessing.  The  new  data,  called  a ground  control  strip  is  practical 
with  todays  storage  and  processing  technologies,  and  could  be  developed 
for  the  next  generation  earth  observation  satellites.  The  design  of  the 
sensor  system  should  be  done  in  conjunction  with  the  ground  system,  as  the 
parameters  are  inter-related.  Study  efforts  are  necessary  in  order  to 
adequately  assess  and  evaluate  this  concept. 
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Figure  2.  MSS  Image  Absolute  Error  As  A Function 
Of  The  Number  Of  Ground  Control  Points 
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ABSTRACT: 


General  discussion  of  extraction  of  metric  information  from  scanner  (par- 
ticularly multispectral)  data  is  presented.  Consideration  is  given  to: 
data  from  both  aircraft  and  spacecraft;  singly  scanned  areas  and  areas 
with  multiple  coverage;  various  mathematical  models  used  up  to  the  pre- 
sent time;  and  published  nunerical  results.  Future  trends  are  also  dis- 
cussed . 

1.  INTRODUCTION: 


The  emphasis  in  this  paper  is  on  the  results  from  passive  sensor  (particularly 
multispectral  scanner)  data,  because  another  invited  paper  is  given  in  this 
Congress  on  active  sensor  data.  It  follows  the  excellent  account  by  Konecny 
(12)  on  the  geometric  restitution  of  remote  sensing  data  where  mathematical 
models,  procedures,  and  nunerical  results  obtained  by  1976  were  given.  For 
ease  in  presentation,  one  section  briefly  describes  all  models  used.  Then,  a 
separate  section  is  devoted  to  the  applications  with  satellite  and  aircraft 
data.  Another  section  discusses  multiseries  data. 

2.  BASIC  MATHEMATICAL  MODELS 


In  the  metric  reduction  of  digital  image  scanner  data,  a mathematical  model  is 
used  to  represent  the  platform/sensor  imaging  characteristics.  All  the  pub- 
lished models  can  be  classified  into  essentially  two  groups.  In  the  first 
group,  a parametric  model  based  on  the  well  known  collinearity  condition  is 
used.  On  the  other  hand,  the  second  group  includes  all  models  which  are  in- 
terpolative  in  nature.  Each  of  these  groups,  with  its  individual  modeling 
process,  is  discussed  in  separate  section. 

2. 1 Parametric  Models 

The  basis  for  these  models  is  the  collinearity  condition  that  the  center  point 
of  an  image  element  or  pixel,  the  point  representing  the  instantaneous  projec- 
tion center,  and  the  center  point  of  the  corresponding  terrain  resolution  ele- 
ment, all  lie  on  a straight  line.  In  addition  to  the  pixel  locations  (corres- 
ponding to  image  coordinates)  and  the  object  point  coordinates,  the  collinear- 
ity equations  usually  contain  six  elements  of  exterior  orientation.  Theoreti- 
cally, because  the  platform  is  continuously  moving,  there  are  six  elements  for 
each  pixel  (assuming  a scanner).  However,  because  of  the  relatively  short 
time  period  of  scanning  one  line  of  imagery,  it  is  common  to  consider  only  one 
set  of  six  elements  for  each  line  (which  makes  it  equivalent  to  linear  array 
scans).  And  even  with  this  assumption,  it  is  easily  seen  that  there  would  be 
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an  excessive  nixnber  of  exterior  orientation  elements  for  any  significant  nun- 
ber  of  image  lines.  Since  these  elements  are  almost  always  unknown  a more 
practical  approach  is  used. 

For  each  element,  some  function  is  used  to  mathematically  model  its  behavior 
trend.  Thus,  for  one  element,  the  function  selected  represents  its  *ariation 
with  time,  or  equivalently  with  the  "line"  number  in  the  digital  image.  (The 
line  nunber  is  used  in  a manner  similar  to  the  use  of  x image  coordinate  in  a 
frame  photograph.) 

The  six  elements  of  exterior  orientation  are  XCf  yc,  Zc,  which  are  positional, 
and  which' are  rotational.  While  these  elements  are  stochastically  un- 

correlated in  the  frame  photography  case,  there  are  very  high  correlations  in 
scanner  imagery  between  the  <u  and  Yc  parameters  and  and  Yc  parameters.  In 
order  to  deal  with  the  correlation  between  <u  and  Yc<  most  scanners  are  roll 
stabilized,  thus  constraining  to  to  zero.  Another  possible  solution  for  air- 
craft scanner  imagery  is  the  use  of  sidelapping  data  sets,  in  order  to  makecu 
recoverable.  The  ability  to  recover  both  ^ and  Xc  is  directly  dependent  on 
the  terrain  relief  relative  to  the  height  of  the  scanner  above  the  terrain. 
The  greater  the  relief  differences,  the  lower  the  correlation.  Another  possi- 
bility is  to  record  the  values  of  0J,<p,  Xc,  or  Yc  in  flight,  then  apply  these 
values  during  the  geometric  processing.  However,  the  most  common  procedure  is 
to  constrain  both  tv  and  4>  to  zero  during  the  adjustment  and  make  no  attempt  to 
recover  their  values. 

2.1.1  Orbit  Modeling  for  Images  From  Spacecraft 

Perhaps  the  most  direct  method  for  functionally  expressing  the  exterior  orien- 
tation elements  for  spacecraft  images  is  to  model  the  vehicle  motion  by  ideal 
orbit  parameters.  Bahr  (1,2)  recommended  the  use  of  the  six  parameters  of  the 
orbit:  semimajor  axis,  a;  eccentricity,  e;  inclination  of  orbital  plane,  i; 
right  ascension  of  ascending  node  Cl;  mean  anomaly,  M.J.;  a .d  the  argument  of 
perigee  tUy.  if  these  parameters  are  known,  then  the  satellite  position  di,\,  r 
as  well  as  nominal  heading  /3n  can  be  calculated  as  functions  of  time.  Ground 
points  are  then  related  to  the  image  points  using  the  collinearity  equations. 

In  these,  while  the  rotational  elements  (gj,<£,k)  of  exterior  orientation  ap- 
pear, the  positional  elements  are  now  replaced  by  functions  of  the  orbital 
parameters.  Small  angle  approximations  are  used  for  thus  avoiding  their 

trigonometric  functions. 

A further  improvement  over  the  orbital  modeling  is  effected  by  Rifman  et.  al. 
(5,22),  where  a linear  sequential  estimator,  or  a Kalman  filter,  is  developed. 

It  is  used  to  estimate  a 13-component  state  vector  from  ground  control  points. 
Twelve  of  these  components  are  the  coefficients  of  cubic  polynomials  in  time 
for  the  sensor  attitude,  and  one  component  is  for  attitude  bias.  This  sequen- 
tial estimation  scheme  offers  several  advantages:  (a)  fewer  numbers  of  ground 

control  points  are  required  to  achieve  a given  performance  level;  (b)  search 
areas  for  ground  control  points  become  smaller  in  size  with  each  state  vector 
update,  permitting  more  rapid  location  of  each  successive  point;  (c)  sequen- 
tial editing  of  control  points  is  possible  without  having  to  process  all  con- 
trol points  first,  thus  control  points  can  be  redefined  or  deleted  as  part  of 
the  editing  process. 
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2.1.2  Vehicle/Sensor  Modeling  by  Polynomials 


Each  of  the  six  exterior  orientatioi.  elements  can  be  represented  by  a polynom- 
ial of  a suitable  >rder  (3,9).  The  selected  polynomial  would  apply  to  a seg- 
ment of  imagery  with  the  corresponding  set  of  coefficients.  Another  set  of 
coefficients  would  be  calculated  for  the  second  image  segment,  and  so  on.  The 
degree  of  the  polynomial  depends,  among  other  things,  upon  the  length  of  the 
segments.  One  possibility  is  to  take  long  segments  with  higher  order  polynom- 
ials; another  is  shorter  segments  with  linear  polynomials.  The  latter  case 
seems  to  work  better,  at  least  for  aircraft  MBS  data  (9). 

The  best  application  of  the  polynomial  modeling  is  to  replace  the  highly  non- 
linear collinearity  equations  by  their  differential,  and  thus  linear,  form. 
Then  the  change  in  each  element  carried,  (e.g.,  dYc,  d<£,  etc.)  is  written  as  a 
polynomial  in  the  image  x-coordinate  (which  is  essentially  equivalent  to 
time).  After  substitution  of  these  polynomials  into  the  pair  of  differential 
formulas  and  reduction  to  equations  are  obtained,  one  for  X and  the  other  for 
Y coordinates  of  the  object  point.  When  several  image  sections  are  used  at 
the  same  time,  constraint  equations  are  written  at  the  section  joints  to  guar- 
antee uniqueness  of  the  object  coordinates. 

2.1.3  Sensor  Modeling  Using  Harmonics 

An  alternative  to  using  polynomials  is  to  use  Fourier  series  expansion  for 
each  of  the  exterior  orientation  elements.  The  sine  and  cosine  functions  ore 
usually  in  terms  of  ratios  of  the  image  coordinates  and  an  equivalent  of  a 
constant  time  interval  which  is  appropriately  chosen  for  the  frequency  of  the 
given  data.  The  linearisation  of  the  harmonic  equations  requires  a somewhat 
different  procedure  than  that  use  for  the  case  of  polynomials  (12). 

2.1.4  Autoregressive  Model  For  Sensor 

All  the  models  discussed  so  far  make  use  of  a deterministic  model  by  writing 
specific  functions  to  represent  the  behavior  of  the  exterior  orientation  ele- 
ments. Another  alternative  is  to  regard  such  behavior  as  stochastic  rather 
than  deterministic  and  employ  an  autoregressive  model  for  the  purpose.  Of  the 
many  possible  autoregressive  processes,  the  Gauss-Markov , both  first  and  se- 
cond order,  have  been  suggested  (7)  and  applied  to  aircraft  MSS  data  (8,9,10, 
11,14,15). 

A Gauss-Markov  process  is  based  on  the  Markovian  assumption  that  the  value  of 
the  process  at  any  time  depends  only  on  the  previous  one  or  two  values,  depen- 
ding on  whether  a first-  or  second-order  process  is  assumed.  Equations  relat- 
ing the  the  orientation  parameters  of  each  line  to  those  of  the  one  or  two 
preceeding  lines  are  used  to  model  the  sensor  behavior.  Control  point  infor- 
mation is  included  by  the  use  of  the  differential  collinearity  equations. 

2.2  Interpolative  Models 

In  the  procedures  employing  these  models  no  attempt  is  made  to  model  the  sen- 
sor/platform behavior,  as  in  the  case  of  using  the  collinearity  conditions  in 
the  parametric  approach.  Instead,  some  function  or  relationship  is  selected 
between  the  X,Y  coordinates  in  the  object  space  and  x,y  (or  row,  column)  in 
the  image  space,  and  assumed  to  represent  the  mapping  from  one  space  to  the 
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other.  There  are  two  groups  of  methods:  one  in  which  a general  transforma- 

tion is  used  for  the  entire  image  record  (or  segment  thereof),  and  the  other 
which  a different  function  is  used  for  each  point  to  be  interpolated.  Each 
of  these  will  be  discussed  separately. 

2.2.1  Interpolation  Methods  Using  General  Transformation: 

The  group  of  procedures  here  employ  a pair  of  factions  (one  for  X,  and  one 
for  Y)  which  holds  for  all  points  in  the  image.  This  means  that  the  numerical 
values  of  the  coefficients  in  the  equations  are  the  same  for  each  of  the 
points  of  interest  in  the  image.  By  image  we  mean  one  segment  or  record. 
Thus,  if  we  are1 working  with  only  one  image  segment,  there  will  be  only  one 
set  of  transformation  coefficients.  However,  if  there  are  more  image  segments 
(in  other  words,  if  the  image  record  is  segmented  into  several  sections),  each 
section  will  have  a set  of  coefficients  with  different  nunerical  values.  It 
is  usually  advisable  to  enforce  constraints  at  the  borders  between  successive 
segments. 

The  transformations  used  include  the  following:  (1)  Four-parameter  transforma- 
tion which  is  ai3o  called  two-dimensional  linear  conformal,  Helmert,  or  simi- 
larity transformation;  it  represents  a uniform  scale  change,  a rotation  be- 
tween Xy  and  xy  axes,  and  two  shifts.  (2)  Six-parameter  or  affine  transforma- 
tion, which  includes  two  scale  changes,  one  rotation,  skewness  or  nonperpendi- 
cularity of  the  axes,  and  two  shifts.  (3)  Eight-parameter  projective  trans- 
formation, which  represents  a rotation  and  two  shifts  in  each  of  the  two 
planes  (XY  and  xy) , and  a tilt  between  the  planes  which  is  combined  with  scale 
to  produce  a continuously  changing  scale  along  lines  of  maximum  tilt.  (JJ) 
General  polynomials  of  varying  degrees;  these  are  usually  of  higher  than  the 
first  order  (which  would  be  the  four-  or  six-parameter  transformation.)  the 
choice  of  degree  depends  on  the  length  of  the  image  segment. 

2-2.2. 1 Weighted  Bean 

For  this  technique,  a weight  function  is  selected  which  is  inversely  propor- 
tional to  a function  of  the  distance  between  the  point  to  be  interpolated  and 
other  reference  points.  Thus,  the  closer  is  a reference  point  the  more  is  its 
contribution  to  the  interpolated  value,  and  vice  versa.  At  any  point  of  in- 
terest, the  required  vector  (usually  calculated  in  two  components)  is  obtained 
as  the  weighted  mean  of  all  vectors  at  reference  points  surrounding  the  point. 
The  choice  of  the  weight  effectively  determines  the  limit  of  the  region  within 
which  reference  points  are  used  to  estimate  at  the  central  point  of  the  re- 
gion. 

2. 2. 2. 2 Moving  Averages 

This  is  a generalization  of  the  weighted  mean  procedure  which  allows  greater 
flexibility  in  point  interpolation.  The  x-  and  /-components  of  the  interpo- 
lated vector  at  a point  are  written  as  functions  of  the  coordinates  of  refer- 
ence points  surrounding  the  point.  Six-parameter  affine  equations,  or  se- 
cond-order polynomials  may  be  used  for  the  purpose.  Usually  a sufficient  num- 
ber of  reference  points  is  used  to  yield  an  over  determination,  and  the  coef- 
ficients of  the  functions  are  estimated  by  weighted  least  squares.  As  before, 
the  weights  are  evaluated  from  a function  with  the  distance  between  the  points 
in  question  and  reference  points  as  the  argument.  Once  these  coefficients  are 
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calculated,  they  are  substituted  back  Into  the  function  to  compute  the  desired 
va;ue.  It  is  important  tc  note  that  a new  set  of  coefficients  must  be  calcu- 
lated for  each  point  to  be  interpolated.  This  usually  makes  the  procedure 
computationally  time  consuming.  Finally,  it  can  be  seen  than  when  the  select- 
ed functions  are  truncated  down  to  only  the  zero  order  terms  the  procedure 
reduces  to  the  weighted  mean. 

2.2. 2. 3 Meshwlse  Linear 

In  this  method,  the  reference  points  are  connected  into  adjacent  cr  contiguous 
meshes  such  as  triangles  or  quadrilaterals.  The  reference  points  forming  the 
mesh  that  includes  the  point  to  be  interpolated  are  used  for  the  purpose.  Us- 
ually a six-parameter  affine  transformation  is  used.  The  method  is  computa- 
tionally efficient  within  each  mesh,  but  the  formation  of  the  meshes  may  be 
time  consuming.  Also  unless  a severe  condition  is  placed  on  the  reference 
points,  the  solution  for  points  on  the  boundary  of  the  image  may  not  be  accur- 
ate due  to  extrapolation. 

2. 2. 2. 4 Linear  Least  Squares  Prediction 

This  method  treats  the  vectors  at  the  reference  points  as  a random  field.  The 
covariance  function  associated  with  this  field  is  either  assumed  a priori,  or 
its  shape  is  assumed  and  the  numerical  parameters  calculated  from  the  data 
(13).  As  applied,  both  stationarity  and  isotropy  of  the  field  are  assumed. 
This  may  be  true  for  some  data  (e.g.,  Satellite  MSS)  but  not  for  other  (e.g., 
aircraft  MSS).  Frot  the  covariance  function,  the  autocovariance  matrix  for 
data  at  the  reference  points  is  evaluated.  Also  the  crosscovariarce  matrix 
(or  vector)  between  the  point  to  be  interpolated  and  the  reference  points  is 
also  needed,  these,  and  the  data  vector  at  the  reference  points  are  used  co 
calculate  the  value  at  the  point  of  point  data  directly  or  filtering  the  data 
for  known  error  proportion.  The  amount  of  filtering  can  also  selected. 

3.  APPLICATIONS  TO  SPACECRAFT  DATA 

The  most  widely  used  spacecraft  data  is  that  obtained  from  the  LANDS  AT  fieri  es 
of  satellites  (see  Ta‘ le  1).  Because  of  this,  the  majority  of  work  on  gaome- 
tric  properties  of  satellite  data  has  been  expended  on  LANDSAT.  Interest  in 
the  Skylab  conical  scanner  data  has  declined  since  the  termination  of  the  Sky- 
lab  project. 

Work  on  LANDSAT  <magery  has  been  mostly  concerned  with  single  scene  proces- 
sing, with  some  attempts  at  strip  and  block  triangulation. 

Bahr  (1,2)  used  LANDSAT  and  NIMBUS  imagery  to  compare  accuracies  achieved  by 
using  a conformal  transformation,  second-order  pjlynomials,  the  collinearity 
condition,  and  linear  least  squares  prediction. 

Borgeson  (4)  reported  on  accuracy  tests  of  bulk  corrected  images  from  the  EROS 
data  center,  using  3.  4,  5,  and  6 parameter  transformations  to  check  residual 
deformation  left  after  bulk  processing  of  the  imagery. 

Rifman  et.  al . (5,22)  studies  the  use  of  a Kalman- filter-type  estimator  for 
registration  of  images  from  LANDSAT  1 and  2,  as  well  as  for  registration  of 
images  from  t)»e  same  sensor. 
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Derouchie  (6)  used  a strip  of  11  image  segments  to  study  control  densities 

necessary  for  various  accuracy  levels.  His  conclusion  was  that  the  optimum 

spacing  of  control  was  every  100  mirror  sweeps*  or  600  image  lines. 

Little  use  has  been  made  of  overlapping  satellite  imagery.  Welch  and  Lo  (23^ 

report  on  the  use  of  a 1-micrcmeter  parallax  bar  combined  with  a Bausch  and 

Lomb  Zoom  70  Stereoscope  to  obtain  elevation  differences.  Up  to  nine  control 
points  were  read  in  each  ciodel,  then  a polynomial  was  used  to  correct  for  sys- 
tematic errors.  Due  to  the  small  scale  and  low  base/height  ratio  cf  the  imag- 
ery, accuracies  of  only  200  to  300  meters  were  obtained. 

The  Skylab  S-192  scanner,  with  its  ccnical  scan  pattern,  presented  special 
geometric  problems.  Murphrey,  et.  al.  (18)  published  a paper  explaining  the 
geometry  of  the  scanner  and  giving  a method  for  geometric  correction  of  t 
data.  The  suggestion  was  to  use  the  orbital  parameters  of  the  satellite  _n 
collinearity  equations  to  determine  a fifth-degree  polynomial  to  transform  the 
image  space  into  object  space.  This  polynomial  is  used  to  transform  a dense 
grid  of  image  points,  then  the  remaining  points  are  determined  by  linear  in- 
terpolation due  to  economic  considerations.  No  predictions  or  checks  were 
made  of  accuracy  achieved. 

Kalhotra  (16,17)  conducted  accuracy  tests  on  the  Skylab  scanner  imagery.  The 
first  phase  of  his  work  involved  using  a parametric  model  and  obtained  accur- 
acies of  4 pixels,  or  about  300  meters.  Another  phase  involved  testing  the 
accuracy  of  generated  film  images  using  an  affine  transformation  to  test  for 
residual  distortions.  Accuracies  ranged  from  105  to  250  meters. 

4.  APPLICATIONS  TO  AIRCRAFT  DATA 

Little  work  is  presently  being  done  on  aircraft  data,  due  to  the  widespread 
use  of  LANDSAT  imagery  (see  Table  2). 

At  Purdue  University,  the  research  has  followed  the  early  work  of  Baker  and 
Mikhail  (3).  Ethridge  and  Mikhail  (9,10,11)  investigated  the  accuracy  of  var- 
ious single-strip  rectification  methods,  including  the  collinearity,  piecewise 
polynomials,  weighted  mean,  moving  average,  meshwise  linear  interpolation t and 
Gauss-Markov . After  testing  all  methods  on  four  data  sets.  Analysis  of  Vari- 
ance (Anova)  and  Neuman-Keuls  statistical  testing  procedures  were  used  to  con- 
clude that  there  was  no  statistically  significant  difference  between  the  re- 
sults of  the  best  five  methods,  with  only  the  meshwise  linear  interpolation 
being  significantly  worse.  When  the  methods  were  ranked  in  terms  of  their 
restitution  results,  the  Gauss-Markov  was  best,  collinearity  and  piecewise 
polynomial  were  second,  the  weighted  mean  was  fourth,  and  moving  averages 
fifth.  Division  of  the  strips  into  sections  when  using  th*  parametric  methods 
was  shown  to  have  a significant  effect.  Consideration  of  other  factors  in- 
volved, such  cS  computational  economy  and  control  reouirements,  led  to  the 
conclusion  that  the  piecewise  polynomial  was  the  optimun  method. 

Ethridge  also  investigated  the  use  of  sidelapping  flight  lines  in  a block  ad- 
justment procedire.  Since  no  real  data  was  available,  randomly  perturbed  and 
unperturbed  simulated  data  was  usel.  Two  algorithms  were  used  in  the  tests, 
one  a rigorous  simultaneous  solution  while  the  other  involved  using  the  con- 
trol points  to  solve  for  the  orientation  parameters,  then  obtaining  pass  point 
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coordinates  by  intersections.  The  resection-intersection  method  gave  results 
nearly  equivalent  to  those  of  the  rigorous  simultanous  method. 

NcGlone,  Mikhail,  and  Baker  (14,15)  reported  on  further  tests  with  single- 
strip methods,  comparing  *ne  piecewise  polynomial,  weighted  mean,  and  Gauss- 
Markov  methods.  The  piecewise  polynomial  method  using  multiple  sections  and 
second-order  polynomials  was  shown  to  be  the  optin  un  method.  Further  compari- 
son tests  run  on  the  first-  and  second-order  Gauss-Markov  methods  showed  in 
general  no  significant  difference  between  the  two,  but  the  second-order  tended 
to  be  slightly  worse. 

Ebner  and  HossleV-  (8)  studies  the  use  of  second-order  Gauss-Markov  processes, 
using  simulated  data.  It  was  concluded  that  redundant  control  within  an  image 
line  did  not  improve  rectification  accuracy,  that  the  control  within  an  image 
line  did  not  improve  rectification  accuracy,  and  that  the  control  distribution 
could  be  random  as  long  as  the  bridging  distances  were  not  too  great.  It  was 
also  concluded  that  the  correlation  time  parameter  of  the  modeling  process 
could  be  chosen  as  infinity  with  no  effect  on  the  results. 

5.  ADJUSTMENT  OF  MULTISERIES  DATA 

Nasu  and  Anderson  (20,21)  reported  on  the  development  of  a multiseries  adjust- 
ment procedure.  This  involved  the  adjustment  of  photography  of  various  scales 
along  with  aircraft  and  spacecraft  scanner  data  in  sequential  and  simultaneous 
procedures,  using  tie  points  selected  on  images.  Digital  tie  point  selection 
between  the  various  data  sets  is  also  possible.  Tests  with  simulated  data 
showed  a 16-  to  20-percent  improvement  over  the  direct  adjustment  of  each  im- 
age separately.  Tests  with  real  data  were  less  conclusive  but  did  show  some 
improvement . 

Tests  were  also  conducted  on  the  block  adjustment  of  sidelapping  data.  It  was 
shown  that  planimeteric  accuracy  is  increased  by  having  multiple  riy  intersec- 
tion and  that  elevations  can  be  obtained,  although  not  of  sufficient  accuracy 
in  this  case  to  use  for  pixel  elevation  assignment  for  geometric  processing. 
For  three  strips,  divided  into  three  sections  each,  the  RMSE  in  x wa3  15.4 
meters  (2.0  pixels),  in  Y 13-3  meters  (1.74  pixels),  and  in  Z 34.0  meters 
(4.46  pixels).  Division  of  the  strips  into  sections  again  increased  the  ac- 
curacy. Calculation  of  covariance  information  for  the  parameters  allowed  the 
assessment  of  correlations  between  the  orientation  parameter?.  The  u>  orien- 
tation angle  was  recoverable  using  multiple  strips,  while  the  was  not  re- 
coverable, due  to  lack  of  relief  of  the  terrain.  The  inclusion  of  ou  increased 
the  accuracy  of  the  adjustment. 

Nasu  (19,20)  studied  the  positioning  of  thermal  IR  scanner  data  using  a para- 
metric orientation  model.  He  reported  residual  errors  at  the  ground  control 
points  of  3 to  4 pixels  in  a test  on  a volcanic  area  with  large  relief  differ- 
ences. 
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Table  ' 


Restitution  Reaulta  fi  Spacecraft  Data 


Number  of 

RMSE.Y 

RMSE.Y 

Investigator 

Data 

Method  i 

Control  pts 

. Pixels 

Pixels 

Bahr 

LANDSAT 

4- par 

239 

2.71 

4.52 

1976 

bulk  image 

2 order  poly 

7 

1.15 

1.11 

9 

0.68 

1.15 

13 

0.60 

1.02 

40 

0.61 

0.89 

239 

0.54 

0.83 

L.S.  filt- 

ering after 

4-par. 

40 

0.56 

0.87 

L.S.  filt- 

ering after 

poly. 

40 

0.53 

0.78 

NIMBUS-3 

col . 

67 

0.68 

0.80 

approx. method 

67 

0.89 

0.73 

col . 

84 

0.83 

0.83 

approx. method 

84 

0.92 

0.97 

col . 

81 

0.79 

0.86 

approx .method 

81 

0.74 

0.87 

NIMBUS-4 

col . 

40 

0.81 

0.89 

apprcx. method 

40 

1.08 

1.25 

Malhotra, 

Skylab 

col . 

— 

4.0 

4.3 

1976 

col . 

— 

4.0 

3.7 

col . 

— 

3.7 

3.8 

RMSE,  XY 

Meters 

Borgeson 

LANDSAT 

3 par 

151 

159 

System 

4 par 

151 

130 

1979 

Corrected 

5 par 

151 

82 

6 par 

151 

51 

LANDSAT 

3 par 

53 

165 

Image 

4 par 

53 

143 

5 par 

53 

84 

6 par 

53 

49 

482 


Table  2 

Restitution  Results  for  Single  Coverage  Aircraft  Data 


Data 

RMSE  X 

RMSE  Y 

RMSE  XY 

Investigator 

Description 

Method 

pixels 

pixels 

pixels 

Ethridge, 

H=  1500m 

col . 1 sec  . 

1.57 

2.03 

1.80 

197? 

IF0V= . 006  rad 

” 2 sec . 

1.51 

1.68 

1.59 

1550  lines 

" 3 sec . 

1.42 

1.36 

1.39 

p.poly  1 sec. 

1.58 

2.01 

1.79 

2 sec . 

1.51 

1.69 

1.60 

3 sec. 

1.42 

1.37 

1.40 

w.  mean 

1.56 

1.23 

1.41 

m.  avg. 

1.3? 

2.04 

1.72 

mesh,  linear 

1.35 

2.26 

1.86 

G.  Markov,  1st 

1.18 

1.44 

1.32 

H= 1500m 

Col . 1 sec . 

2.70 

2.19 

2.45 

IF0V= . 006  rad 

2 " 

2.57 

1.82 

2.  19 

1H00  lines 

3 " 

2.70 

1.37 

2.04 

p.poly  1 sec. 

2.68 

2.38 

2.51 

2 " 

2.57 

2.18 

2.37 

3 " 

2.71 

1.36 

2.03 

w.mean 

3-2 

1.52 

2.55 

M.  avg. 

2.7* 

1.95 

2.38 

mesh,  lineai 

2.50 

2.42 

2.46 

G.  Markow,  1st 

2.05 

2.33 

2.20 

H=900m 

Col  1 sec . 

7.33 

9.66 

8.58 

IF0V= .006  rad 

2 • 

3.69 

5.17 

9.49 

1970  lines 

3 ” 

2.89 

3.08 

2.99 

p.poly  1 sec. 

7.3? 

8.71 

8.05 

2 " 

3.66 

4.74 

4.24 

3 " 

2.89 

3.15 

3.02 

w.mean 

3.05 

4.44 

3.81 

m.avg. 

2.62 

3.91 

3-3? 

mesh,  linear 

4.35 

4.82 

4.59 

G.  Markov,  1st 

2.43 

2.80 

2.62 

H=900m 

Col.  1 sec. 

4.10 

4.24 

3-90 

IF0V= .006  rad 

2 " 

4.23 

3.76 

3 . 34 

2700  lines 

3 " 

4.16 

4.01 

3.63 

p.poly  1 sec. 

4.09 

4.32 

4.21 

2 " 

4.18 

3.16 

3.71 

3 " 

3.83 

3.10 

3.4Q 

w.mean 

3.75 

2.9, 

3.36 

m.avg. 

5.33 

3.58 

4.54 

mesh . 1 inear 

4.2? 

7.65 

6.  18 

G.  Markov  1st 

3.66 

3.77 

3.72 

Mcglone, 

H=  3050m 

p.poly  1 sec  1 order  2.76 

4.76 

4.  14 

Mikhail , 

IFOV=0025  rad 

1 "2  " 

2.72 

1.91 

2.35 

Baker 

1450  lines 

2 " 1 " 

2.82 

2.49 

2.66 

1980 

2 « 2 w 

2.23 

1.74 

2.00 

3 ” 1 " 

2.22 

1.98 

2.  10 

3 « 2 " 

2.06 

1.89 

1.98 

483 


Table  2 (Continued) 


Data 

RMSE  X 

RMSE  Y 

RMSE  X 

Investigator  Description 

Method 

pixels 

pixels 

pixels 

w.mean 

3.34 

1.90 

2.72 

G.  Markov  1 

order 

1.75 

5.47 

4.06 

2 

M 

3.80 

11.20 

8.36 

H= 3050m 

p.poly  1 

sec  1 order 

• 2.14 

3.85 

3.11 

IF0V= .0025  rad 

1 

n 

2 " 

2.14 

3.79 

3.08 

1450  lines 

2 

n 

1 " 

2.11 

3.78 

3.06 

2 

n 

2 " 

1.57 

3.39 

2.64 

-» 

J> 

it 

1 " 

1.86 

3.63 

2.88 

3 

n 

2 " 

1.69 

3.50 

2.75 

w.  mean 

3.28 

3.85 

3.58 

G. Markov 

i 

order 

1.13 

6.63 

4.75 

2 

n 

1.18 

7.13 

5.11 

Hr 3050m 

p.poly  1 

sec  1 order 

2.1? 

5.33 

4.05 

IFOVr. 0025  rad 

1 

It 

2 " 

1.31 

5.38 

3.92 

1450  lines 

2 

It 

1 " 

1.43 

5.41 

3.96 

2 

n 

2 " 

1.28 

5.26 

3.81 

3 

vt 

1 " 

1 .42 

5.21 

3.82 

3 

t! 

2 " 

1 .08 

7.43 

5.31 

w.mean 

2.80 

4.17 

3.55 

G. Markov 

1 

order 

1.03 

10.48 

7.45 

2 

n 

1.67 

10.11 

7.25 

Hr  1500m 

G. Markov 

'i 

order 

1.27 

1.32 

1.30 

IFOVr. 006  rad 

2 

ft 

1.33 

1.49 

1.42 

Hri5C0m 

G. Markov 

1 

order 

3-26 

2.34 

2.83 

IF0V=. 006  rad 

2 

tt 

3.86 

2.53 

3.26 

Hr900m 

G. Markov 

1 

order 

0.90 

2.10 

1.62 

IFOVr. 006  rad 

2 

tt 

1.64 

2.72 

2.25 

Hr900m 

G. Markov 

1 

order 

1.99 

1.80 

1 .90 

IFOVr. 006  rad 

2 

2.15 

5.95 

4.47 

Hr900m 

G. Markov 

1 

order 

3*16 

2.26 

2.75 

IFOVr. 066  rad 

2 

n 

3.30 

2.28 

2.84 

Hr 900m 

G. Markov 

order 

6.64 

3.77 

5.40 

IFOVr. 006  rad 

2 

vt 

14.46 

4.76 

10.76 
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Code  ECD-4 

Data  Systems  Branch 

NASA  Headquarters 

600  Independence  Ave.  SW 

Washington,  DC  205*16 

(202)755-8573  FTS  755-8573 

Dr.  Roy  Welch  Map  Accuracy 

University  of  Georgia 
Athens,  GA  30602 
(404)c.42-2o56 

*.  Robert  Wolfe  Inter-Image  Matching 

Johnson  Space  Flight  Center 
Mail  Code  56 
1322  Space  Park  Drive 
Houston,  TX  77058 
(713)333-5060 


Airborne  Scanner 
Systems 


496 


Remapping  Procedures 


Dr . A1  Zobrist 
Jet  Propulsion  Laboratory 
Hail  Stop  168-5 14 
4800  Oak  Grove  Dr. 
Pasedena,  CA  91 103 
(213)354-3237  FTS  792-3237 
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9.3  REGISTRATION  AND  RECTIFICATION  WORKSHOP  AGENDA 


Tuesday,  November  17,  1981 

JOINT  MEETING  TO  BE  HELD  IN  ROOM  2464 


1.  Introduction  (8:00-9:00)  Workshop  Chairman:  N.  Bryant/JPL 


Workshop  Sponsor:  A.  Villasenor/NASA 

2. 

Objectives  and  Format  of  Workshop  (9:00-9:30) 

a. 

Format 

N.  Bryant/JPL 

b. 

Objectives 

F.  Billingsley/JPL 

3. 

Presentations  on  Users  Needs  (9:30-12:00)  (1:00-2:00) 

Agriculture/Forestry,  Rangeland 

R.  Allen/USDA 

C'  • 

Land  Use/Land  Cover  and  Hydrology 

L.  Gaydos/USGS 

c. 

Geology 

P.  Chavez/USGS 

d. 

Severe  Storms 

J.  Dalton/GSFC 

e. 

Ocean  Processes 

D.  Nichols/JPL 

4. 

Pre 

sentations  on  Space  Segment  Errors  (2:00-4; 

00) 

a. 

Scanner  Imaging  Systems,  Spaceborne 

A.  Prakash/GE 

b. 

Scanner  Imaging  Systems,  Aircraft 

S.  Unger/GISS 

c. 

MLA  Imaging  Systems 

K.  Ando/NASA 

d. 

SAR  Imaging  Systems 

J.  Curlander/JPL 

e. 

Multimission  Spacecraft 

H.  Heuberger/GSFC 

f. 

NAVSTAR/Global  Positioning  System 

M.  Ananda/ Aerospace 

5. 

Presentations  on  Ground  Segment  Errors  (4:00-5 

:00) 

a. 

Geodetic  Control  Net  Considerations 

J.  Gergen/NGS 

b • 

National  Map  Accuracy  Standards 

R.  Welch/U  OF  GA 

c. 

Map  Projections 

J.  Snyder/USGS 

6. 

Systems  Presentations  and  Discussions  (7:00-9: 

00) 

a* 

Quantitative  Effects  of  Misregistration 

R.  Juday/JSC 

b. 

Data  vs.  Information,  A System  Paradigm 

F.  Billingsley/JPL 

c . 

Panel  Chairman  Overview  Discussions 

- Registration  Panel 

R.  Bernstein/IBM 

- Rectification  Panel 

A.  Tescher/Aerospace 

- Error  Analysis  Panel 

R.  Pelzman/Lockheed 
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Wednesday,  November  18,  1981 


7.  Presentations  on  Processing  and  Verification  (8:00-12:00) 


a.  Registration 

- Image  Sharpness 

- Feature  Extraction 

- Inter-Image  Matching 

b.  Rectification 

- Remapping  Procedures 

- Resampling  Functions 

c.  Error  Analysis 

- Error  Characterization  and  Error 
Budgets 

- Methods  of  Verification 


P.  Anuta/Purdue 
R.  Haralick/VPI 
R.  Wolfe/IBM 

E,  Mikhail/Purdue  and 
A.  Zobrist/JPL 
R.  Dye/ERIM 


E.  Beyer/GE 
G.  Grebowsky/GSFC 


8.  Panel s/Subpenels  Meeting  (1:00-5:00) 

(Identify  state-of-the-art  technology,  recommendations,  etc.) 


a . 

Registration  Subpanels 

Chairmen 

Room 

3289 

- Image  Sharpness 

P.  Anuta/Purdue 

Room 

3257 

- Feature  Extraction 

L.  Davis/U  OF  MD 

Room 

3263 

b. 

- Inter-Image  Matching 
Rectification  Subpanels 

H.  Ramapriyan 

Room 

3265 

- Remapping  Procedures 

A.  Tescher/ Aerospace 

Room 

3463 

c. 

- Resampling  Functions 
Error  Analysis 

- Error  Characterization  and  Error 

R.  Juday/JSC 

Room 

3370 

Budgets 

J.  Barker/GSFC 

Room 

3465 

- Methods  of  Verification 

R.  Pel zman/Lockheed 

9. 

Discussions  by  Members-at-Large  (7:00-9:00) 

a. 

Registration  Techniques  Panel  Chairman 

R.  Bernstein/IBM 

b. 

Rectification  Techniques  Panel  Chairman 

A.  Tescher/ Aerospace 

c . 

Error  Analysis  Panel  Chairman 

R.  Pel zman/Lockheed 

Thursday  November  19,  1981 

10.  Panels/ Subpenels  Meetings  (9:00-12:00) 
(Develop  program  plans  and  recommendations) 

11.  Presentations  to  Menbers-at-Large  (1:00-3:00) 


a. 

Recommendations,  Registration  Panel 
Chairman 

R.  Bernstein/IBM 

b. 

Recommendations,  Rectification  Panel 
Chairman 

A.  Tescher/ Aerospace 

c. 

Recommendations,  Error  Analysis  Chairman 

R.  Pel zman/Lockheed 

Workshop  Overview 

F.  Billingsley/JPL 
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9.4  PANEL  DISCUSSION  HANDOUTS 


1.  Subpanel:  Image  Sharpness 

2.  Panel:  Registration 

3.  Chairman:  Paul  Anuta,  Purdue  University 

4.  Discussant:  Paul  Anuta.  Purdue  University 

5.  Areas  of  Concern:  Fundamental  principles  in  instantaneous  field  of  view 
versus  the  point  spread  function  in  digital  image  enhancement.  Methods  for 
improving  visual  recognition  of  ground  control  point  regions  in  imaged.  Sig- 
r.al-to-noise  ratio  impacts  associated  with  effective  fields  of  view  (as  op- 
posed to  instantaneous  fields  of  view). 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications'  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of  de- 
parture, adding  new  elements  neglected  and  deleting  elements  of  little  appar- 
ent concern  to  NASA  and  the  user  community. 

b)  Develop  a position  statement  on  anticipated  requirements  for  those  ele- 
ments in  applications'  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  t ^hnology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  group.  •'nd  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  medium-range  capabilities.  Recommend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 

a)  Master  Image  Sets:  In  the  context  of  image  sharpness  concerns,  discuss 
whether  or  not  there  should  be  a set  of  master  image  sets  for  registration. 
What  data  should  be  used  for  this  master  set?  Should  these  data  be  converted 
into  a particular  geometry  or  projection?  Can  a master  image  set  serve  as  a 
reference  image  for  future  processing,  eliminating  or  reducing  the  need  for 
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establishing  and  maintaining  a ground  control  point  library9  Should  there  be 
a national  or  global  digital  dat:.  base?  If  so,  what  registration  strategy 
should  be  pursued? 

b)  Inaccuracies:  How  do  inaccuracies  propagate  through  a system? 

c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

*he  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Interpolation:  What  effects  do  the  various  interpolation  kernels  have  on 

resolution,  transient  rise  distances,  or  point  spread  function?  For  the 
users:  are  these  important? 

e)  Which  techniques  are  most  optimal  under  which  conditions? 

f)  Can  we  precisely  define  differences  in  radiometric  and  geometric  errors? 

g)  Data:  What  kinds  of  data  sets  need  to  be  registered?  What  are  the  dimen- 

sions of  these  data  sets?  What  are  the  number  and  types  of  these  data  sets 
now  and  to  be  anticipated  in  the  future? 

h)  What  applications  success  has  been  achieved  to  date  with  registering  data? 
What  techniques  were  used?  Was  the  data  changed  as  a result  of  registration 
processing,  and  if  so,  what  was  the  effect  of  the  change? 

i)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  to  improve  image  sharpness  results? 

j)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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1.  Subpanel:  Feature  Extraction 


2.  Panel:  Registration 

3.  Chairman:  Larry  Davis,  University  of  Maryland 
Discussant:  Robert  Haralick,  Virginia  Polytechnic  Institute 

5.  Areas  of  Concern:  Review  processing  that  can  be  applied  to  images  to  im- 
prove the  capability  for  discriminating  features  within  an  image  to  obtain 
improved  ground  control  point  identification.  Texture  processing  functions  to 
enhance  image  gradients  and  identification  of  subpixel  texture  components. 
Skeletonizing  images  for  subsequent  matching  to  a vector  representation  of  a 
map  area. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications'  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of  de- 
parture, adding  new  elements  neglected  and  deleting  elements  of  little  appar- 
ent concern  to  NASA  and  the  user  community. 

b)  Develop  a position  statement  on  anticipated  requirements  for  those  ele- 
ments in  applications'  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
impleur.-nt  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  medium-range  capabilities.  Recommend  levels  of  effort  (man- 
year;',  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 

a)  Master  Image  Sets:  In  the  context  of  feature  extraction  concerns,  discuss 
whether  or  not  there  should  be  a set  of  master  image  sets  for  registration. 
What  data  should  be  used  for  this  master  set?  Should  these  data  be  converted 
into  a particular  geometry  or  projection?  Can  a master  image  set  serve  as  a 
reference  image  for  future  processing,  eliminating  or  reducing  the  need  for 
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establishing  and  maintaining  a ground  control  point  library?  Should  there  be 
a national  or  global  digital  data  base?  If  so,  what  registration  strategy 
should  be  pursued? 

b)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

c)  Correction  Methods:  What  correction  methods  are  available  for  system  use? 

What  correction  methods  are  available  for  user  use?  How  well  can  they  poten- 
tially work,  and  how  well  can  they  be  expected  to  work? 

d)  Can  desirable  ground  control  points  be  characterized? 

e)  Is  it  possible  to  correlate  images  to  maps  without  manual  intervention? 

f)  What  image  preprocessing  is  useful  prior  to  feature  extraction? 

g)  How  should  one  treat  relief  distortion? 

h)  Interpolation:  What  effects  do  the  various  interpolation  kernels  have  on 

resolution,  transient  rise  distances,  or  point  spread  function?  For  the 
users:  are  these  important? 

i)  Data:  What  kinds  of  data  sets  need  to  be  registered?  What  are  the  char- 

acteristics of  these  data  sets?  What  are  the  number  and  types  of  these  data 
sets  now  and  to  be  anticipated  in  the  future? 

j)  Is  the  data  changed  when  processed  to  achieve  registration?  What  is  the 
effect  of  this  change? 

k)  Ground  control  point  libraries  are  costly  to  build.  What  techniques/pro- 
cedures are  available  to  pattern/feature  recognition  to  identify  scene  content 
without  correlation  to  reference  chips?  Which  techniques  are  most  optimal 
under  which  conditions? 

l)  How  do  the  important  characters  of  features  propagate  through  the  system. 
What  are  these  characteristics? 

m)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  to  improve  image  sharpness  results? 

n)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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1 . Subpanel:  Inter-Image  Hatching 

2.  Panel:  Registration 

3.  Chairman:  H.  Ramapriyan,  GSFC 

4.  Discussant:  Robert  Wolfe,  IBM 

5.  Areas  of  Concern:  Procedures  and  algorithms  used  to  determine  relative 
positions  of  reference  and  registrant  image  at  inter-image  subimages.  Includ- 
ing FFT,  cross-correlation,  and  surface  estimation  from  discrete  rasters.  Im- 
pacts associated  with  translat'ion , rotation,  .scale,  and  keysconing  of  pixels 
on  the  registration  process.  Discuss  search  procedures  for  GCP  location. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications'  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of 
departure,  adding  new  elements  neglected  and  deleting  elements  of  little  ap- 
parent concern  to  NASA  and  the  user  community. 

b)  Develop  a position  statement  on  anticipated  requirements  for  those  ele- 
ments in  applications'  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  delet'ng  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  mediun-range  capabilities.  Reccmmend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Qjestions  lo  Consider: 

a)  Master  Image  Sets:  In  the  context  of  inter-image  matching  concerns,  dis- 
cuss whether  or  not  there  should  be  a set  of  master  image  sets  for  registra- 
tion. What  data  should  be  used  for  this  master  set?  Should  these  data  be 
converted  into  a particular  geometry  or  projection?  Can  a master  image  set 
3erve  as  a reference  image  for  future  processing,  eliminating  or  reducing  the 
need  for  establishing  and  maintaining  a ground  control  point  library?  Should 
there  be  a national  or  global  digital  data  base?  If  so,  what  registration 
strategy  should  be  pursued? 
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b)  Inaccuracies:  How  do  inaccuracies  propagate  through  a system?  How  do 

uncertainties  propagate  through  the  system? 

c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Correction  Methods:  What  correction  methods  are  available  for  system  use? 
What  correction  methods  are  available  for  user  use?  How  well  can  they  poten- 
tially work,  and  how  well  can  they  be  expected  to  work? 

e)  How  does  brightness  response  (e.g.,  striping)  affect  control  point  corre- 
lation? 

f)  What  procedures  should  be  pursued  to  correlate  sensors  having  different 
resolutions? 

g)  Can  desirable  ground  control  points  be  characterized? 

h)  How  can  one  correlate  areas  imaged  at  different  seasons? 

i)  What  preprocessing  is  useful? 

j)  How  can  one  treat  relief  distortions? 

k)  What  is  the  accuracy  of  temporal  overlays  using  registration  tiepoints  vs. 
rectifying  each  image  to  a set  of  GCPs? 

l)  Processing:  Should  geographic  location  parameters  be  available  to  users? 

What  accuracy  should  they  have?  Will  the  users  be  able  to  do  precision  regis- 
tration with  the  data  available  within  each  digital  frame?  To  what  accuracy? 

m)  Disciplines:  What  is  the  sensitivity  to  data  registration  loss  or  missing 

temporal  analysis  within  disciplines?  What  types  of  error  description  (e.g., 
RMS,  peak,  locally  mapped)  are  needed  for  each  discipline?  Can  these  be  pro- 
vided? 

n)  Can  a logical  structure  be  developed  to  display  the  sequence  platform  mo- 
deling, platform -related  sensors,  NAVSTAR/GPS,  ground  control  points,  regis- 
tration tiepoints,  (etc.),  used  in  the  rectification  process?  Wh">t  positional 
accuracy  improvement  might  be  expected  at  each  step  in  the  sequence? 

o)  Data:  What  kinds  of  data  sets  need  to  be  registered?  What  are  the  dimen- 

sions of  these  data  sets?  What  are  the  number  and  types  of  these  data  sets 
now  and  to  be  anticipated  in  the  future? 

p)  Accuracy:  What  are  the  relative  and  absolute  accuracy  requirements?  How 

is  accuracy  measured  and  evaluated? 

q)  What  applications  success  has  been  achieved  to  date  with  registering  data? 
What  techniques  were  used?  Was  the  data  changed  as  a result  of  registration 
processing,  and  if  so,  what  is  the  effect  of  the  change? 
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r)  How  much  human  interaction  is  required  to  register  data  sets?  Is  this 
necessary,  and,  if  so,  to  what  extent  can  manual  interaction  be  reduced?  How 
much  does  human  subjectivity  affect  the  result? 

s)  How  significant  a role  would  a sensor/platform  model  play  in  registration/ 
rectification  of  the  data  acquired  from  different  sensors  on  efferent  plat- 
forms (e.g.,  shuttle/SAH  and  Landsat/TM)? 

t)  Ground  control  point  libraries  are  costly  to  build.  Which  techniques  are 
most  optional  under  which  conditions? 

u)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  tc  improve  image  sharpness  results? 

v)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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1.  Subpanel:  Remapping  Procedures 


2.  Panel:  Rectification 

3.  Chair  in:  Andrew  Tescher,  Aerospace  Corp. 

Discussant:  Edward  Mikhail,  Purdue,  and  A1  Zobrist,  JPL 

5.  Areas  oi  Concern:  Procedures  associated  with  the  photcgrammetric  and  com- 
putational aspects  of  remapping  images  from  nomin^ly  orlhophotc  to  map-pro- 
jected space.  Control  net  generation  and  surface  remapping  models;  i.e.,  sur- 
face fitting,  gridding,  rubber-sheeting  methods,  spacecraft  model  incorpora- 
tion, and  terrain/elevation  compensation. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  el.ements  in 
applications'  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  ser.or  data.  Use  the  paper  presented  as  a point  of  oe- 
parture,  adding  new  elements  neglected  and  deleting  element > o"  little  appar- 
ent c icern  to  NASA  and  the  user  lommunity. 

b)  Develop  a position  statement  on  anticipated  requirements  for  those  ele- 
ments in  application*;'  techniques  of  concern  tc  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA,  List  the  cen- 
ters of  expertise  (field  center  grouos  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  Tnis  sl-uld  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  mediim-range  capabilities.  Recommend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 


a)  Master  Image  Sets:  I,,  the  context  of  remapping  concerns,  discuss  whether 

or  not  there  should  be  a set  of  master  image  set3  for  registration.  What  data 
should  be  used  for  this  master  set?  Should  these  data  be  converted  into  a 
particular  geometry  or  projection?  Can  a master  image  set  serve  as  a refer- 
ence image  for  future  processing,  eliminating  or  reducing  the  need  for  estab- 
lishing and  maintaining  a ground  control  point  library?  ould  there  t>e  a 
national  or  global  digital  data  base?  If  so,  what  registration  strategy 
should  be  pursued? 
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b)  Inaccuracies:  i'ow  do  inaccuracies  propagate  through  a system? 


c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Correction  Methods:  What  correction  methods  are  available  for  system  use? 

What  correction  methods  are  available  for  user  use?  How  well  can  they  poten- 
tially work,  and  how  well  can  they  be  expected  to  work? 

e)  With  what  accuracy  is  the  platform  position  known  with  and  without  GCPs? 
How  accurately  can  a platform  be  expected  to  repeat  coverage  of  a given  swath 
area?  Is  this  the  same  at  all  earth  locations?  How  accurately  is  the  atti- 
tude and  altitude  known,  and  what  are  the  accuracies  (registration  and  recti- 
fication) possible  after  processing? 

f)  For  aircraft  sensors,  what  are  the  platform  conditions,  and  are  ancillary 
sensors  necessary  and/or  available? 

g)  Can  per-swath  modelling  really  be  done,  and  if  so,  how  are/ should  the  GCPs 
be  utilized?  What  open  loop  positional  accuracies  are  available  with  and 
without  GCPs? 

h)  How  many  GCPs  are  needed  to  accurately  model  the  distortions  for  given 
sensor  systems? 

i)  How  accurate  are  GCPs  worldwide? 

j)  What  preprocessing  is  useful? 

k)  How  should  one  treat  relief  distortions? 

l)  What  is  the  iccuracy  of  temporal  overlays  using  registration  tiepoints  vs. 
rectifying  each  image  to  a set  of  GCPs? 

m)  Can  a world-wide  map  be  drawn  of  expected  geometric  (including  ground  lo- 
cation) accuracy? 

n)  Processing:  Should  geographic  locaticr.  parameters  be  available  to  us*>rs? 

What  accuracy  should  they  have?  Will  the  users  be  able  to  do  precision  regis- 
tration with  the  data  available  with  each  digital  frame?  To  what  accuracy? 

o)  Disciplines:  What  is  the  sensitivity  to  data  registration  loss  or  missing 

temporal  overlays  within  disciplines?  Vhat  types  of  error  description  (e.g., 
RMS,  peak,  locally  mapped)  are  needed  for  each  discipline?  Can  these  be  pro- 
vided? 

p)  Can  a logical  structure  be  developed  to  disple  the  sequence  in  which 

platform  modeling,  platform-rel  '.^d  sensors,  NAVSTA\/GPS,  ground  control 
points,  registration  tiepMnts  ( ) are  used  in  the  rectification  process? 

What  accuracies  might  be  expect-  un  each  step  in  the  sequence? 


q)  Data;  What  kinds  of  data  sets  need  to  be  registered?  What  are  the  dimen- 
sions of  these  data  sets?  What  are  the  number  and  types  of  these  data  sets 
now  and  to  be  anticipated  in  the  future? 

r)  Accuracy:  What  are  the  relative  and  absolute  accuracy  requirements?  How 
is  accuracy  measured  and  evaluated? 

s)  "hat  success  has  been  achieved  to  date  with  registering  data? 

t)  What  applications  success  has  been  achieved  to  date  with  registering  data? 
What  techniques  were  used?  Was  the  data  changed  as  a result  of  registration 
processing,  and  if  so,  what  is  the  effect  of  the  change? 

u)  How  much  human  interaction  is  required  to  register  data  sets?  Is  this 
necessary,  and,  if  so,  to  what  extent  can  manual  interaction  be  reduced?  How 
ouch  does  human  subjectivity  effect  the  result? 

v)  How  significant  a role  would  a sensor/platform  model  play  in  registration/ 
rectifications  of  the  data  acquired  from  different  sensors  on  different  plat- 
forms (e.g.,  shuttle/SAR  and  Landsat/TM)? 

w)  Although  the  registration  and  rectification  processes  are  somewhat  simi- 
lar, they  are  also  somewhat  different;  is  there  a methodology  that  can  be  used 
for  both? 

x)  Ground  control  point  libraries  are  costly  to  build.  Which  techniques  are 
most  optimal  under  which  conditions? 

y)  What  is  involved  in  remapping  from  one  map  projection  or  scale  to  another? 

z)  How  would  we  relate  NASA's  GCP  net  with  established  geodetic  control  nets? 
aa)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developeo  or 
manipulated  to  improve  remapping  procedure  results? 

bb)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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1*  Subpanel:  Resampling  Functions 

2.  Panel:  Rectification 

3.  Chairman:  Richard  Juday,  JSC 
Discussant:  Robert  Dye,  ERIM 

5.  Areas  of  Concern:  The  effect  of  resampling  procedures  upon  signal-to- 
noise  ratio  for  digital  imagery.  Discuss  the  relative  impact  of  bilinear, 
nearest  neighbor,  cubic  spline,  and  associated  hybrid  resampling  algorithms 
upon  the  information  content  of  pixels  and  local  geometric  fidelity. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications*  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of  de- 
parture, adding  new  elements  neglected  and  deleting  elements  of  little  appar- 
ent concern  to  NASA  and  the  user  community. 

fc)  Develop  a position  statement  on  anticipated  requirements  for  these  ele- 
merts  in  applications*  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  meaium-range  capabilities.  Recommend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 

a^  Master  Image  Sets:  In  the  context  cf  resampling  functions,  discuss  whe- 
ther or  not  there  should  be  a set  of  master  image  sets  for  registration.  What 
data  should  be  used  for  this  master  set?  Should  these  data  be  converted  into 
a particular  geometry  or  projection?  Can  a master  image  set  serve  as  a refer- 
ence image  for  future  processing,  eliminating  or  reducing  the  need  for  estab- 
lishing and  maintaining  a ground  control  point  library?  Should  ther^  be  a 
national  or  global  digital  data  base?  If  so,  what  registration  strategy 
should  be  pursued? 
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b)  Inaccuracies:  How  do  inaccuracies  propagate  through  a system? 

c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Correction  Methods:  What  correction  methods  are  available  fo^  system  use? 

What  correction  methods  are  available  for  user  use?  How  well  can  they  poten- 
tially work,  and  how  well  can  they  be  expected  to  work? 

e)  Interpolation:  What  effects  do  the  various  interpolation  kernals  have  on 

resolutior,  transient  rise  distances,  or  point  spread  function?  For  the 
users:  are  these  important? 

f)  Disciplines:  What  is  the  sensitivity  to  data  registration  loss  or  missing 

temporal  overlaps  within  disciplines?  What  types  of  error  description  (e.g., 
RMS,  peak,  locally  mapped)  are  needed  for  each  discipline?  Can  these  be  pro- 
vided? 

g)  Is  the  data  changed  when  processed  to  achieve  registration?  What  is  the 
effect  of  this  change? 

h)  What  applications  success  has  been  achieved  to  date  with  registering  data? 
What  techniques  were  used? 

i)  Althougn  registration  and  rectification  processes  are  somewhat  similar, 
they  are  also  somewhat  different;  is  there  a methodology  that  can  be  used  for 
both? 

j)  Which  registration/rectification,  techniques  are  most  optimal  under  which 
conditions? 

k)  Can  we  precisely  define  differences  in  radiometric  and  geometric  errors? 

l)  Are  there  different  optimal  sampling  functions  for  human  image  interpreta- 
tion analysis  and  machine  information  extraction  processing? 

m)  Should  resampling  functions  be  the  same  in  botli  the  'ong-  and  across- 
track  direction?  How  might  interpolation  functions  vary  at  ’.ing  to  overlap 
of  sensor  IFOV? 

n)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  to  improve  resampling  procedure  results? 

o)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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u Subpanel:  Error  Characterization  and  Error  Budgets 

2.  Panel:  Error  Analysis 

3*  Chairman:  John  Barker,  GSFC 

4.  Discussant:  Erie,  Beyer,  G.E. 

5.  Areas  of  Concern:  The  essential  components  that  contribute  to  the  error 

associated  with  the  projected  position  of  pixels  in  spaceborne  imaging  sys- 
tems. Distinguish  between  the  spaceeraft/sensor  error  ellipse  budget  for  a 
given  pixel  location  and  the  computational  error  associated  with  algorithm/ 
model  performance  and  assumptions  for  ground  segment  processing.  Deal  with 
error  budgets  that  include  and  do  not  include  ground  control  points. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications1  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of  de- 
parture, adding  new  elements  neglected  and  deleting  elements  of  little  appar- 
ent concern  to  NASA  and  the  user  community. 

b)  Develop  a position  statement  on  anticipated  requirements  for  those  ele- 
ments in  applications'  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  medium-range  capabilities.  Recommend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 

a ) Master  Image  Sets:  In  the  context  of  error  characterization  and  error 

budgets,  discuss  whether  or  not  there  should  be  a set  of  master  image  sets  for 
registration.  What  data  should  be  used  for  this  master  set?  Should  these 
data  be  converted  inco  a particular  geometry  or  projection?  Can  a master  im- 
age set  serve  as  a reference  image  for  future  processing,  eliminating  or  re- 
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ducing  the  need  for  establishing  and  maintaining  a ground  control  point  li- 
brary? Should  there  be  a national  or  global  digital  data  base?  If  so,  what 
registration  strategy  should  be  pursued? 

b)  Inaccuracies:  How  do  inaccuracies  propagate  through  a system? 

c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 
the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Sensor-positional  errors  will  be  of  two  types:  those  which  are  predic- 

table and  therefore  presumably  can  be  "calibrated  out"  (rectified),  but  with 
residual  uncertainties  in  the  calibration,  and  those  which  are  implicitely 
random  and  for  which  ancillary  data  are  required.  What  is  the  error  budget 
for  a particular  sensor?  What  errors  can  be  calibrated,  and  which  must  use 
real  image  data  for  correction?  Can  the  sensor  be  adequately  modeled?  Is  the 
required  ancillary  data  available?  What  differences  in  performance  are  pre- 
sent in  different  types  of  sensors  - (scanners,  linear  arrays,  aircraft  vs 
spacecraft,  etc.)? 

e)  With  what  accuracy  is  the  platform  position  known  with  and  without  GCPs? 
How  accurately  can  a platform  be  expected  to  repeat  coverage  of  a given  swath 
area?  Is  this  the  same  at  all  earth  locations?  How  accurately  is  the  atti- 
tude and  altitude  known,  and  what  are  the  accuracies  (registration  and  recti- 
fication) possible  after  processing? 

f)  Can  a world-wide  map  be  drawn  of  expected  geometric  (including  ground  lo- 
cation) accuracy? 

g)  Interpolation:  What  effects  do  the  various  interpolation  kernels  have  on 

resolution,  transient  rise  distances,  or  point  spread  function?  For  the  user: 
are  these  important? 

h)  Processing:  Should  geographic  location  parameters  be  available  to  users? 

What  accuracy  should  they  have?  Will  the  users  be  able  to  do  precise  regis- 
tration with  the  data  available  with  each  digital  frame?  To  what  accuracy? 

i)  Disciplines:  What  is  the  sensitivity  to  data  registration  loss  or  missing 

temporal  overlays  within  disciplines?  What  types  of  error  description  (e.g., 
RMS,  peak,  locally  mapped)  are  needed  for  each  discipline?  Can  these  be  pro- 
hvided? 

j)  Can  a logical  structure  be  developed  to  display  the  sequence  in  which 
platform  modeling,  platform-related  sensors,  NAVSTA«/GPS,  ground  control 
points,  registration  tiepoints  (etc.)  are  used  in  the  rectification  process? 
What  accuracies  might  be  expected  at  each  step  in  the  sequence? 

k)  Accuracy:  What  are  the  relative  and  absolute  accuracy  requirements?  How 

is  accuracy  measured  and  evaluated? 

l)  What  success  has  been  achieved  to  date  with  registering  data? 

m)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  to  improve  error  characterization  results? 
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n)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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1.  Subpanel:  Methods  of  Verification 

2.  Panel;  Erro^  Analysis 

3*  Chairman:  Robert  Pelzmann,  Lockheed 
ii.  Discussant;  Gerald  GreLowsky,  GSFC 

5.  Areas  of  Concern:  Procedures  used  for  verifying  the  positional  occurance 
of  pixel  observed  versus  projected  latitude/longitude  position  in  spaceborne 
images*  Procedures  that  include  and  do  not  include  ground  control  points  in 
the  data  projection  process. 

6.  Charge  to  Panel  Working  Group: 

a)  Develop  a position  statement  on  the  state  of  the  art  for  those  elements  in 
applications*  techniques  of  concern  to  this  subpanel  for  the  registration/rec- 
tification of  imaging  sensor  data.  Use  the  paper  presented  as  a point  of  de- 
parture, adding  new  elements  neglected  and  deleting  elements  of  little  appar- 
ent concern  to  NASA  and  the  user  community. 

b)  Develop  a position  statement  on  anticipated  requirements  for  these  ele- 
ments in  applications*  techniques  of  concern  to  this  subpanel  for  the  regis- 
tration/rectification of  imaging  sensor  data.  Use  the  paper  presented  as  a 
point  of  departure,  adding  new  elements  neglected  and  deleting  elements  of 
little  apparent  concern  to  NASA  and  the  user  community. 

c)  Outline  the  current  status  of  the  technology  within  NASA.  List  the  cen- 
ters of  expertise  (field  center  groups  and  university/industry  support 
groups) . 

d)  Propose  experiments  that  should  be  conducted  to  test  and  document  areas  of 
concern  to  this  panel  in  technique  applications.  This  should  include  synthe- 
tic and  standardized  data  sets. 

e)  Discuss  the  feasibility  of  providing  tested  software  systems  packages  to 
implement  standard  procedures  presently  developed.  Recommend  candidate  sys- 
tems for  the  "registration  processors"  survey. 

f)  Identify  research  tasks  that  the  subpanel  feels  should  be  pursued  to  en- 
hance near-  and  medium-range  capabilities.  Recommend  levels  of  effort  (man- 
years,  dollars)  and  task  duration.  Prioritize  the  research  tasks. 

7.  General  Questions  to  Consider: 

a)  Master  Image  Sets:  In  the  context  of  verification  procedures,  discuss 
whether  or  not  there  should  be  a set  of  master  image  sets  for  registration. 
What  data  should  be  used  for  this  master  set?  Should  these  data  be  converted 
into  a particular  geometry  or  projection?  Can  a master  image  set  serve  as  a 
reference  image  for  future  processing,  eliminating  or  reducing  the  need  for 
establishing  and  maintaining  a ground  control  point  library?  Should  there  be 
a national  or  global  digital  data  base?  If  so,  what  registration  strategy 
should  be  pursued? 
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b)  Inaccuracies:  How  do  inaccuracies  propagate  through  a system? 

c)  Performance:  What  is  the  best  achievable  accuracy  one  could  expect  with 

the  algorithms  at  hand  for  a given  data  type  being  analyzed? 

d)  Sensor  - positional  errors  will  be  of  two  types:  those  which  are  predic- 

table and  therefore  presumably  can  be  "calibrated  out"  (rectified),  but  with 
residual  uncertainties  in  the  calibration,  and  those  which  are  implicitely 
random  and  for  which  ancillary  data  are  required.  What  is  the  error  budget 
for  a particular  sensor?  What  errors  can  be  calibrated,  and  which  much  use 
real  image  data  for  correction?  Can  the  sensor  be  adequately  modeled?  Is  the 
required  ancillary  data  available?  What  differences  in  performance  are  pre- 
sent in  different  types  of  sensors  (scanners,  linear  arrays,  aircraft  vs 
spacecraft,  etc.)? 

e)  Can  a world-wide  map  be  drawn  of  expected  geometric  (including  ground  lo- 
cation) accuracy? 

f)  Processing:  Should  geographic  location  paramete-s  be  available  to  users? 

What  accuracy  should  they  have?  Will  the  users  be  able  to  do  precision  regis- 
tration with  the  data  available  with  each  digital  frame?  To  what  accuracy? 

g)  How  much  human  interaction  is  required  to  register  data  sets?  Is  this 
necessary,  and  if  so  to  what  extent  can  manual  interaction  be  reduced?  How 
much  does  human  subjectivity  effect  the  result? 

h)  Are  recursive  techniques  of  great  value  for  modelling  platform  errors  like 
attitude? 

i)  Is  accuracy  really  paramount  for  registration/ rectification? 

j)  Can  we  precisely  define  the  distortions,  errors,  tolerances,  reference 
data,  and  quality  of  processing  in  the  rectification/regictration  process? 

k)  Is  segment  magnification/reduction  and  the  overlaying  of  these  segments 
for  alignment  a good  test  for  accuracy? 

l)  What  verification  methods  are  applicable  to  the  process?  Is  there  a prac- 
tical scheme  to  be  implemented? 

m)  Can  we  develop  standard  performance  parameters  for  reporting  accuracy  of  a 
registration/ rectification  system? 

n)  What  are  the  various  verification  procedures  (e.g.,  visual,  interactive, 
automated,  analytical)  and  what  has  been  the  performance  and  limitations  of 
each? 

o)  Are  there  specific  sensor  subsystem  parameters  that  can  be  developed  or 
manipulated  to  improve  verification  procedure  results? 

p)  Is  it  possible  to  define  surrogate  conditions  for  choosing  optimal  tech- 
niques? 
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9.5  DEFINITION  OF  TERMS 


Registration:  The  alignment  of  imaging  sensor  data  to  another  image,  a sub- 

image, or  identifiable  objects  on  a map. 

Rectification:  The  conversion  of  rpatially  indexed  sensor  data  to  a mathema- 

tically defined  coordinate  system  relating  to  latitude  and 
longitude. 

Geocoding:  The  process  of  registering  spatial  data  in  a manner  that  achieves 

retrievability  by  geographic  referencing. 

Data  Integration:  The  process  of  registering  discrete  and  spatially  distri- 

buted sensor  data  sets  and  ancillary  data  bases  in  a manner 
which  accounts  for  measurement  incongruencies  and  provides 
spatially  comparable  data  sets. 

Systematic  Error:  Reproducible  inaccuracy  introduced  by  faulty  equipment, 

calibration,  or  technique. 

Random  Error:  Indefiniteness  of  result  due  to  finite  precision  of  experiment. 

Measure  of  fluctuation  in  result  after  repeated  experimenta- 
tion. 

Probable  Error:  Indefiniteness  of  error  which  is  estimated  to  have  been  made 

in  determination  of  results. 

Accuracy:  Measure  of  how  close  the  result  of  the  experiment  comes  to  the 

"true"  value. 

Precision:  Measure  of  how  exactly  the  result  is  determined  without  reference 

to  any  "true"  value. 
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